Scraping Fish

The simplest API for web scraping without getting blocked.

Visit Website
January 10, 2025 Big Updates for Scraping Fish! 🌊

We’ve been hard at work enhancing our web scraping API, and we’re excited to share some new features:

Intercept XHR/Fetch Requests: Take control of request-level interactions effortlessly. Learn More

Screenshots + HTML in One Request: Simplify your workflow with combined screenshot & HTML retrieval. Learn More

Clean Text Extraction: Use advanced extraction rules for clean, structured data. Learn More

🔧 Plus, we’ve rolled out performance upgrades and stability fixes for an even smoother experience.

And this is just the beginning—more features and improvements are on the way! 🚀

Curious about Scraping Fish? Reach out to us for a free starter pack and see how it can supercharge your data scraping needs. Get Started

Comment

October 24, 2024 Performance Optimizations

In the last few weeks we were working hard on improving the product for all our customers by optimizing the API response time. We've made several significant changes to our custom browsers and infrastructure which resulted in 15% faster response times on average and reduced resource requirements in the back end.

The best part was that our users didn't have to do anything to benefit from this. There was no API change. Their scraping jobs just started running 15% faster on average.

This is something we are really proud of and it's the most rewarding part of working on our own product.

Happy scraping everyone,
The Scraping Fish Team 🐟

Comment

September 1, 2024 Scraping Fish Unlimited Scraping Plans

Unlock you web scraping potential! We’re introducing new monthly subscription options tailored to provide you with unlimited requests. Now, you can scrape as much as you want without worrying about request limits!

What’s New?

  • Unlimited Requests: We have new monthly plans which come with unlimited scraping requests, so you can focus on your projects without any restrictions.
  • Flexible Pricing Based on Concurrency: Our pricing is now based on the maximum concurrency you need. You only pay for the level of performance you require!

Why This Matters:

Whether you’re a solo developer, a startup, or a scaling business, you can now choose a plan that perfectly fits your needs and budget. With unlimited requests and scalable concurrency options, Scraping Fish provides you with the flexibility to handle any scraping workload.

Ready to get started? Check out our new plans at https://scrapingfish.com/unlimited and see which one suits your scraping needs best!

As always, we’re here to support your projects and help you succeed. Let us know if you have any questions or need any help.

Happy scraping!

Cheers,
The Scraping Fish Team 🐟

Comment

July 26, 2024 Scraping Fish Affiliate Program

Hey Indie Hackers!

We’re thrilled to announce the launch of our Scraping Fish Affiliate Program! If you love web scraping and want to monetize your network, this is for you.

Why Join?

  • Earn 25% Recurring Commissions: You get 25% of every payment from the customers you refer!
  • Easy to Join: Sign up, grab your unique affiliate link, and start sharing it with your audience.
  • No Limits: There’s no cap on how much you can earn. The more you refer, the more you earn!

How to Get Started?

  1. Sign Up: Visit Scraping Fish Affiliates to create your affiliate account.
  2. Share Your Link: Use your affiliate link on blogs, social media, newsletters, or anywhere else you think people would benefit from Scraping Fish.
  3. Earn Commissions: Get paid for every customer that signs up through your link!

Join us today and start earning while helping others simplify their web scraping needs. We’re excited to grow with you!

Cheers,
The Scraping Fish Team 🐟

Comment

February 1, 2024 Scraping Fish 2024 Update

We're excited to share significant updates to Scraping Fish, aimed at making web scraping more efficient and user-friendly. Highlights include:

  • Default maximum concurrent requests increased to 25 per domain.
  • Introduction of click_if_exists for smarter JavaScript interactions.
  • Autorenew Packs for continuous, interruption-free scraping.
  • Email notifications for nearing the end of request packs.
  • Improved anti-bot measures and infrastructure enhancements.

These updates reflect our commitment to providing a robust and versatile web scraping API that meets the evolving needs of our users.

Dive into the details and see how these improvements can benefit your scraping projects: https://scrapingfish.com/blog/product-updates-2024

Comment

September 26, 2023 Learn How We Grew Scraping Fish 🚀

Hey HackerNews Community!

We're thrilled to share that Scraping Fish has been featured (again) in a new IndieHackers article: "Indie hackers share how they got their first 10, 100, and 1,000 customers".

In the article, we delve into our journey of user growth, from our initial 10 customers to approaching the 1,000 mark! We discuss the role of high-quality content, SEO, community engagement, and the importance of user feedback and reviews in our growth trajectory.

We’d love for you to check it out and share your thoughts! Whether you're an indie hacker, a seasoned developer, or someone with a penchant for startups, we believe our experiences could offer some valuable insights.

Thanks for all your support, and here's to more learning and growing together!

Check out the article: https://www.indiehackers.com/post/indie-hackers-share-how-they-got-their-first-10-100-and-1-000-customers-620ce768ba

Comment

July 19, 2023 A Perspective on Google's Web Scraping and Data Ethics from Scraping Fish

We are excited to share that we were recently featured in an insightful discussion on Indie Hackers. This conversation delves into the implications of Google's updated privacy policy, and the broader context of web scraping.

Being deeply involved in the AI and data scraping sectors, we at Scraping Fish believe in the criticality of such dialogues. It's essential for us to question and understand the ethical dimensions, potential, and challenges introduced by technological advancements.

In this discourse, we bring forth several important points on the uneven landscape of web scraping. We highlighted the disproportionate impact of legal challenges related to web scraping on smaller entities. Additionally, we emphasized the immediate need for regulations around publicly available data use that protect authors' rights while ensuring no preferential treatment to tech giants.

We see this conversation as a significant step in our continuous commitment to cultivate a balanced, transparent, and ethical AI and web scraping ecosystem. We encourage you to read the full article and engage in this important conversation with us.

Here's the link to the full article: https://www.indiehackers.com/post/it-will-be-the-greatest-theft-in-the-entire-history-of-humanity-indie-hackers-weigh-in-on-big-ai-companies-scraping-the-web-6e78a4a4b7

We welcome your thoughts and insights!

Best,
The Scraping Fish Team

Comment

June 29, 2023 State of Web Scraping 2023 Survey Results

Hey IndieHackers!

We're thrilled to share that we recently conducted our inaugural Web Scraping Survey 2023, a first-of-its-kind initiative by the team behind Scraping Fish. We reached out to our user base of developers, data scientists, and hobbyists to gather insights on the evolving landscape of web scraping.

We're excited to share that we've published the results of the survey on our Scraping Fish blog, and the findings are incredibly enlightening! From revealing that Python is the preferred language among web scrapers to understanding that a significant portion of our community scrapes a broad range of data, the insights have truly been fascinating.

Moreover, we found that ethics in web scraping emerged as a key area of concern, underlining the community's commitment to responsible data gathering. This has been heartening to see and will shape our work in Scraping Fish moving forward.

In the spirit of openness and fostering a community of informed developers, we've made all the survey data publicly available. We hope this will encourage healthy discussions and facilitate collaborative learning.

Check out the full results here: https://scrapingfish.com/blog/survey-2023-results

We'd like to express our gratitude to all those who participated. Your insights are invaluable to us, and they help shape the future of web scraping. We're already excited to see how these trends evolve in the next year's survey!

The Scraping Fish team is committed to continually improving and adapting to the needs of our users. Your feedback plays a critical role in this process, and we're always open to hearing your thoughts.

Keep scraping responsibly!

Comment

May 11, 2023 State of Web Scraping 2023 Survey

We're excited to share that we've just launched the 'State of Web Scraping 2023' survey. Embracing the spirit of open knowledge, we aim to help the web scraping community understand itself better. That's why we're making both raw data and results publicly available. Our goal is to turn this into an annual endeavor, similar to what other tech communities do.

To participate in the 'State of Web Scraping 2023' survey, please follow this link: https://forms.gle/Wsi24nWHHe2qLbPZ8.

As a thank you for your time, we're offering a 50% discount on our web scraping API, Scraping Fish, to all participants.

Whether you're a seasoned web scraper, a software developer, a business owner, or just starting out in the field, your experiences and insights are invaluable. The survey covers a wide range of topics: from your role and expertise in web scraping, the tools and languages you prefer, to your thoughts on the ethics and challenges associated with web scraping.

Thank you in advance for your time and insights. We can't wait to share the collective knowledge we gather from this endeavor.

Also, if you have any feedback on the survey itself or if there's anything more you'd want to learn about the web scraping community, please let us know.

Comment

January 16, 2023 Marketing and Community Engagement

Recently, we've been putting a lot of effort into increasing the visibility of Scraping Fish. One of the ways we've been doing this is by registering on popular product listing sites like Capterra and AlternativeTo. This has allowed us to get our product in front of a wider audience and increase our online presence.

You can check out our listing on Capterra and on AlternativeTo.

Another important aspect of our marketing efforts has been collecting reviews. While we're still in the process of gathering reviews, we want to make sure our users have enough time to test out the product before leaving their feedback. If you're interested in leaving a review, you can do so here: https://reviews.capterra.com/new/276174/effaac09-c8d8-4f8c-9b8a-cb75d2e5edc1?lang=en

Lastly, we've been actively engaging with our audience on social media. We've found that regularly visiting and participating in online communities like Reddit, Twitter, Indie Hackers, and Hacker News has been a great way to increase our visibility and connect with potential customers. This strategy was suggested here on Indie Hackers and we've found it to be working well for us.

Overall, we're excited about the progress we've made and the impact our marketing efforts are having on our product's visibility. We'll continue to work hard to get Scraping Fish in front of as many people as possible, and we appreciate your support!

Comment

About

Scraping Fish API helps people scrape websites to collect all kinds of data from the Internet, e.g., real estate, e-commerce, or social media. It is powered by 4G LTE proxies - the best type of proxy for web scraping.