I'm looking for a Pingdom-like service that tests websites on different browsers using different viewport sizes. I don't think Pingdom has that feature. Ideally, I want to be able to say:
I know I could use Selenium for tests, but I want something simpler to setup for various testing environments. Ideally, I could choose the operating system and the type and version of the browsers to run commands from.
The goal is to continuously test my websites using the environments that I know most of my website/app visitors are on.
Any ideas?
---- UPDATE ---
I found this to be impressive: https://reflect.run
Not a bunch of browsers yet - but their tech handles the test scenarios I need much better than Pingdom.
browserstack.com try this
This looks like what I'm looking for! Thanks a lot!
Hey Yasser, if you have the time to learn & setup a new tool, code a few tests, and setup a CI server that runs them regularly, I'd recommend Cypress.
If you prefer to have more control and not have to pay money for over 500 test runs per month, Puppeteer + Jest + jest-image-snapshots on a CI server is a good bet. The downside is that it's quite difficult to record videos, and tests usually end up pretty hard to debug and maintain.
Alternatively, you can use Browse AI. I'm probably biased! Because I made it! but I believe it's the perfect product for people and teams that:
*We have some pretty complex stuff going on behind the scenes to maintain your tests. For example, for each element you interact with during a test, we generate dozens and sometimes hundreds of selectors, and automatically adjust them as you make changes to your web application. This way you rarely have to re-record a test.
That being said, Browse AI doesn't do a couple of things you asked for:
I was going to add a demo video of using Browse AI for automated testing to the site in the next few days. It's not all ready yet, but I just uploaded it on Vimeo for you so you can take a look and see if it solves the problem for you: https://vimeo.com/435622035
Hope this helps.
Hey Ardy. Thanks for your detailed answer! Very helpful.
Browse AI is a very compelling service, well done on launching and getting to where you are today. The main reason why I want these tests is to check on environments I rarely (never) test manually during development, e.g. various browser environment combinations that aren't Chrome/FF/Safari.
Ah I see. Yeah you need a different solution then. Most people recommend Selenium but it's a nightmare compared to those other solutions I mentioned. I never came across a better alternative for testing with browsers like IE.
I worked at a company that used https://saucelabs.com/. From what I know it worked pretty well but there was always hesitation because it was so expensive.
You could also try https://www.lambdatest.com/. I don't have any experience with that one.
cypress.io is an awesome alternative to selenium. They rebuilt browser testing from the ground up using new browser APIs and I think it's way easier to use and set up tests. I haven't used their hosted testing solution, though.
It seems like for any of these, the services are very expensive because it's pretty intensive to run the tests in real environments. You've got to weigh the pros and cons of paying the price of these hosted platforms and rolling your own with some automation tools and on site computers.
Personally, when I get to the point of setting up testing like this, I'm going to try setting up a local CI/CD setup on an old mac mini and windows desktop I have laying around.
Very helpful! Thanks Ryan! Never heard of saucelabs so I'll look into that, not sure I'll use them though if they're expensive. I do have a laptop with a damaged screen and keyboard which I could probably use for a local CI/CD setup! Thanks again!
Shameless plug, I have a productized service https://uppington.io that you basically sign up and someone will handle the creating tests for you