Fast X/Twitter scraper for tweet details and profile/highlights first-screen items; outputs JSON, Markdown, and full-page screenshots (Playwright, configurable wait/timeout).
Learn how this template works and how to run it
Reliable extractor for X (formerly Twitter). Supports single Tweet detail pages and first-screen items on profile and Highlights pages. Built on Playwright with a fixed wait to ensure dynamic content renders. Produces human-readable Markdown, structured JSON, and a full-page screenshot.
Cost: 1 credits per call
Engine: Playwright. Extraction runs after a fixed delay for reliability.
https://twitter.com/*/status/*https://x.com/*/status/*https://twitter.com/*https://x.com/*https://twitter.com/*/highlights*https://x.com/*/highlights*https://mobile.twitter.com/*, https://mobile.x.com/*Notes:
/status/ return a single tweet item.url (required): X/Twitter page URL (tweet detail, profile, or highlights)variables.waitFor (optional, default 1500): extra wait in milliseconds before extractionvariables.timeoutMs (optional, default 30000): page load and extraction timeout in milliseconds{
"url": "https://x.com/USER/status/1871234567890",
"variables": {
"waitFor": 1500,
"timeoutMs": 30000
}
}
Profile/Highlights example:
{
"url": "https://x.com/USER/highlights",
"variables": {
"waitFor": 1500
}
}
This template produces:
screenshot@fullPage)[
{
"from": "tweet",
"type": "tweet",
"id": "1970851007530701283",
"url": "https://x.com/NASA/status/1970851007530701283",
"twitterUrl": "https://twitter.com/NASA/status/1970851007530701283",
"text": "LIVE: Hear from the astronauts flying aboard the Artemis II test flight โ the first crewed Artemis mission โ in early 2026.\n\nTheir ~10-day mission will launch from @NASAKennedy in Florida, fly around the Moon, and splash down in the Pacific Ocean. https://t.co/qdWyUFD2aE",
"retweetCount": 678,
"replyCount": 279,
"likeCount": 3034,
"quoteCount": 65,
"viewCount": 530015,
"bookmarkCount": 180,
"createdAt": "Wed Sep 24 14:01:11 +0000 2025",
"lang": "en",
"isReply": false,
"conversationId": "1970851007530701283",
"possiblySensitive": false,
"author": {
"type": "user",
"id": "11348282",
"userName": "NASA",
"name": "NASA",
"isBlueVerified": true,
"description": "Official NASA account. Exploring the universe, advancing science, and inspiring the next generation of explorers.\n\nVerification: https://t.co/8nok3NP4PW",
"location": "Pale Blue Dot",
"url": "https://x.com/NASA",
"twitterUrl": "https://twitter.com/NASA",
"externalUrl": "http://www.nasa.gov/",
"followers": 88185317,
"following": 158,
"listedCount": 96833,
"statusesCount": 73110,
"profileBannerUrl": "https://pbs.twimg.com/profile_banners/11348282/1718393721",
"profilePicture": "https://pbs.twimg.com/profile_images/1321163587679784960/0ZxKlEKB_normal.jpg",
"verifiedType": "Government"
},
"displayUrls": [],
"images": [],
"isRetweet": false,
"isQuote": false,
"raw": {
"edit_control": {
"edit_tweet_ids": ["1970851007530701283"],
"editable_until_msecs": "1758726071000",
"is_edit_eligible": false,
"edits_remaining": "5"
},
"unmention_data": {},
"is_translatable": false,
"views": {
"count": "530015",
"state": "EnabledWithCount"
},
"grok_analysis_button": false
}
}
]
[
{
"from": "posts",
"type": "tweet",
"id": "1970800503740104993",
"url": "https://x.com/NASA/status/1970800503740104993",
"twitterUrl": "https://twitter.com/NASA/status/1970800503740104993",
"text": "LIVE: Join us for the launch of three missions to investigate how the Sun impacts Earth, astronauts, and the solar system. Share your questions with #AskNASA and we'll answer a few on air! https://t.co/3y219NvTsA",
"retweetCount": 772,
"replyCount": 292,
"likeCount": 4634,
"quoteCount": 59,
"viewCount": 5920244,
"bookmarkCount": 557,
"createdAt": "Wed Sep 24 10:40:30 +0000 2025",
"lang": "en",
"isReply": false,
"conversationId": "1970800503740104993",
"possiblySensitive": false,
"author": {
"type": "user",
"id": "11348282",
"userName": "NASA",
"name": "NASA",
"isBlueVerified": true,
"description": "Official NASA account. Exploring the universe, advancing science, and inspiring the next generation of explorers.\n\nVerification: https://t.co/8nok3NP4PW",
"location": "Pale Blue Dot",
"url": "https://x.com/NASA",
"twitterUrl": "https://twitter.com/NASA",
"externalUrl": "http://www.nasa.gov/",
"followers": 88185317,
"following": 158,
"listedCount": 96833,
"statusesCount": 73110,
"profileBannerUrl": "https://pbs.twimg.com/profile_banners/11348282/1718393721",
"profilePicture": "https://pbs.twimg.com/profile_images/1321163587679784960/0ZxKlEKB_normal.jpg",
"verifiedType": "Government"
},
"displayUrls": [],
"images": [],
"isRetweet": false,
"isQuote": false,
"raw": {
"edit_control": {
"edit_tweet_ids": ["1970800503740104993"],
"editable_until_msecs": "1758714030000",
"is_edit_eligible": false,
"edits_remaining": "5"
},
"unmention_data": {},
"is_translatable": false,
"views": {
"count": "5920244",
"state": "EnabledWithCount"
},
"grok_analysis_button": false
}
},
{
"from": "highlights",
"type": "tweet",
"id": "1970518651741589686",
"url": "https://x.com/NASA/status/1970518651741589686",
"twitterUrl": "https://twitter.com/NASA/status/1970518651741589686",
"text": "LIVE: Learn all about the innovative science and tech flying aboard the Artemis II mission.\n \nScientific investigations will fly alongside the four astronauts around the Moon, including ways to monitor astronaut health. https://t.co/j7wAq8RiI1",
"retweetCount": 438,
"replyCount": 148,
"likeCount": 2160,
"quoteCount": 28,
"viewCount": 421238,
"bookmarkCount": 252,
"createdAt": "Tue Sep 23 16:00:31 +0000 2025",
"lang": "en",
"isReply": false,
"conversationId": "1970518651741589686",
"possiblySensitive": false,
"author": {
"type": "user",
"id": "11348282",
"userName": "NASA",
"name": "NASA",
"isBlueVerified": true,
"description": "Official NASA account. Exploring the universe, advancing science, and inspiring the next generation of explorers.\n\nVerification: https://t.co/8nok3NP4PW",
"location": "Pale Blue Dot",
"url": "https://x.com/NASA",
"twitterUrl": "https://twitter.com/NASA",
"externalUrl": "http://www.nasa.gov/",
"followers": 88185317,
"following": 158,
"listedCount": 96833,
"statusesCount": 73110,
"profileBannerUrl": "https://pbs.twimg.com/profile_banners/11348282/1718393721",
"profilePicture": "https://pbs.twimg.com/profile_images/1321163587679784960/0ZxKlEKB_normal.jpg",
"verifiedType": "Government"
},
"displayUrls": [],
"images": [],
"isRetweet": false,
"isQuote": false,
"raw": {
"edit_control": {
"edit_tweet_ids": ["1970518651741589686"],
"editable_until_msecs": "1758646831000",
"is_edit_eligible": true,
"edits_remaining": "5"
},
"unmention_data": {},
"is_translatable": false,
"views": {
"count": "421238",
"state": "EnabledWithCount"
},
"grok_analysis_button": false
}
}
]
Note: list pages only include currently rendered items; no automatic scrolling.
Excerpted from a real profile run (trimmed):
[
{
"from": "posts",
"type": "tweet",
"id": "1970800503740104993",
"url": "https://x.com/NASA/status/1970800503740104993",
"twitterUrl": "https://twitter.com/NASA/status/1970800503740104993",
"text": "LIVE: Join us for the launch of three missions to investigate how the Sun impacts Earth, astronauts, and the solar system. Share your questions with #AskNASA and we'll answer a few on air! https://t.co/3y219NvTsA",
"retweetCount": 772,
"replyCount": 292,
"likeCount": 4634,
"quoteCount": 59,
"viewCount": 5920244,
"bookmarkCount": 557,
"createdAt": "Wed Sep 24 10:40:30 +0000 2025",
"lang": "en",
"isReply": false,
"conversationId": "1970800503740104993",
"possiblySensitive": false,
"author": {
"type": "user",
"id": "11348282",
"userName": "NASA",
"name": "NASA",
"isBlueVerified": true,
"description": "Official NASA account. Exploring the universe, advancing science, and inspiring the next generation of explorers.\n\nVerification: https://t.co/8nok3NP4PW",
"location": "Pale Blue Dot",
"url": "https://x.com/NASA",
"twitterUrl": "https://twitter.com/NASA",
"externalUrl": "http://www.nasa.gov/",
"followers": 88185317,
"following": 158,
"listedCount": 96833,
"statusesCount": 73110,
"profileBannerUrl": "https://pbs.twimg.com/profile_banners/11348282/1718393721",
"profilePicture": "https://pbs.twimg.com/profile_images/1321163587679784960/0ZxKlEKB_normal.jpg",
"verifiedType": "Government"
},
"displayUrls": [],
"images": [],
"isRetweet": false,
"isQuote": false,
"raw": {
"edit_control": {
"edit_tweet_ids": ["1970800503740104993"],
"editable_until_msecs": "1758714030000",
"is_edit_eligible": false,
"edits_remaining": "5"
},
"unmention_data": {},
"is_translatable": false,
"views": {
"count": "5920244",
"state": "EnabledWithCount"
},
"grok_analysis_button": false
}
}
]
waitFor: fixed delay after navigation to let dynamic content settletimeoutMs: maximum wait for page load and selector renderingwaitFor or adjust selectors if neededwaitFor, and configure proxies at the project levelwaitFor; ensure the URL is public; check for DOM changesEnsure your use complies with X/Twitterโs Terms of Service and applicable laws.
Get the latest news and updates delivered to your inbox.
ยฉ 2026 AnyCrawl. All rights reserved.