Skip to content

Instantly share code, notes, and snippets.

@kristoph

kristoph/batch_scrape_failure_0.txt

Created November 4, 2024 17:04
Show Gist options
  • Save kristoph/ee658b7d7fe0ea16a1d435a069be8295 to your computer and use it in GitHub Desktop.
Save kristoph/ee658b7d7fe0ea16a1d435a069be8295 to your computer and use it in GitHub Desktop.
Download ZIP
Firecrawl: url of call with result from that that call
Raw
batch_scrape_failure_0.txt
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471
{:success=>true, :status=>"scraping", :completed=>0, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=0", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=0
{:success=>true, :status=>"scraping", :completed=>0, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=0", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=0
{:success=>true, :status=>"scraping", :completed=>0, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=0", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=0
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[{:markdown=>"# Example Domain\n\nThis domain is for use in illustrative examples in documents. You may use this\ndomain in literature without prior coordination or asking for permission.\n\n[More information...](https://www.iana.org/domains/example)", :screenshot=>"https://service.firecrawl.dev/storage/v1/object/public/media/screenshot-da6bd609-6592-4d84-baa6-0412efea2afc.png", :metadata=>{:title=>"Example Domain", :viewport=>"width=device-width, initial-scale=1", :sourceURL=>"https://example.org", :ogLocaleAlternate=>[], :statusCode=>200}}, {:markdown=>"# Example Domains\n\nAs described in [RFC 2606](/go/rfc2606) and [RFC 6761](/go/rfc6761), a\nnumber of domains such as example.com and example.org are maintained\nfor documentation purposes. These domains may be used as illustrative\nexamples in documents without prior coordination with us. They are not\navailable for registration or transfer.\n\nWe provide a web service on the example domain hosts to provide basic\ninformation on the purpose of the domain. These web services are\nprovided as best effort, but are not designed to support production\napplications. While incidental traffic for incorrectly configured\napplications is expected, please do not design applications that require\nthe example domains to have operating HTTP service.\n\n## Further Reading\n\n- [IANA-managed Reserved Domains](/domains/reserved)\n\nLast revised 2017-05-13.", :screenshot=>"https://service.firecrawl.dev/storage/v1/object/public/media/screenshot-75d0fcce-def3-4423-bef3-41a281edb34e.png", :metadata=>{:title=>"Example Domains", :viewport=>"width=device-width, initial-scale=1", :sourceURL=>"https://www.iana.org/help/example-domains", :ogLocaleAlternate=>[], :statusCode=>200}}]}
Title: Example Domain
Screenshot: https://service.firecrawl.dev/storage/v1/object/public/media/screenshot-da6bd609-6592-4d84-baa6-0412efea2afc.png
---
# Example Domain
This domain is for use in illustrative examples in documents. You may use this
domain in literature without prior coordination or asking for permission.
[More information...](https://www.iana.org/domains/example)
Title: Example Domains
Screenshot: https://service.firecrawl.dev/storage/v1/object/public/media/screenshot-75d0fcce-def3-4423-bef3-41a281edb34e.png
---
# Example Domains
As described in [RFC 2606](/go/rfc2606) and [RFC 6761](/go/rfc6761), a
number of domains such as example.com and example.org are maintained
for documentation purposes. These domains may be used as illustrative
examples in documents without prior coordination with us. They are not
available for registration or transfer.
We provide a web service on the example domain hosts to provide basic
information on the purpose of the domain. These web services are
provided as best effort, but are not designed to support production
applications. While incidental traffic for incorrectly configured
applications is expected, please do not design applications that require
the example domains to have operating HTTP service.
## Further Reading
- [IANA-managed Reserved Domains](/domains/reserved)
Last revised 2017-05-13.
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"scraping", :completed=>2, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :next=>"https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2", :data=>[]}
https://api.firecrawl.dev/v1/batch/scrape/e6d1cc2b-3884-4e16-b219-7fb8a155f471?skip=2
{:success=>true, :status=>"completed", :completed=>3, :total=>3, :creditsUsed=>3, :expiresAt=>"2024-11-05T17:01:42.000Z", :data=>[{:markdown=>"# Example Domains\n\nAs described in [RFC 2606](/go/rfc2606) and [RFC 6761](/go/rfc6761), a\nnumber of domains such as example.com and example.org are maintained\nfor documentation purposes. These domains may be used as illustrative\nexamples in documents without prior coordination with us. They are not\navailable for registration or transfer.\n\nWe provide a web service on the example domain hosts to provide basic\ninformation on the purpose of the domain. These web services are\nprovided as best effort, but are not designed to support production\napplications. While incidental traffic for incorrectly configured\napplications is expected, please do not design applications that require\nthe example domains to have operating HTTP service.\n\n## Further Reading\n\n- [IANA-managed Reserved Domains](/domains/reserved)\n\nLast revised 2017-05-13.", :screenshot=>"https://service.firecrawl.dev/storage/v1/object/public/media/screenshot-75d0fcce-def3-4423-bef3-41a281edb34e.png", :metadata=>{:title=>"Example Domains", :viewport=>"width=device-width, initial-scale=1", :sourceURL=>"https://www.iana.org/help/example-domains", :ogLocaleAlternate=>[], :statusCode=>200}}]}
Title: Example Domains
Screenshot: https://service.firecrawl.dev/storage/v1/object/public/media/screenshot-75d0fcce-def3-4423-bef3-41a281edb34e.png
---
# Example Domains
As described in [RFC 2606](/go/rfc2606) and [RFC 6761](/go/rfc6761), a
number of domains such as example.com and example.org are maintained
for documentation purposes. These domains may be used as illustrative
examples in documents without prior coordination with us. They are not
available for registration or transfer.
We provide a web service on the example domain hosts to provide basic
information on the purpose of the domain. These web services are
provided as best effort, but are not designed to support production
applications. While incidental traffic for incorrectly configured
applications is expected, please do not design applications that require
the example domains to have operating HTTP service.
## Further Reading
- [IANA-managed Reserved Domains](/domains/reserved)
Last revised 2017-05-13.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment