No-code big data database?
I have a large dataset (±60k rows/daily) that I want to present in a sortable/searchable table. Nothing fancy.
Because of the size of the dataset, I figure there's a way to do what I'm looking for with BigQuerie or Microsoft Azure, but I'm wondering if there exists a no-code way to make a simple and quick table. I currently use Google Data Studio with Sheets, but it's way too slow.
Thank you for any advice!
I have often thought about building such a thing but the existence of Google Data Studio has always put me off the idea, so it's interesting (to me anyway) that you have hit a limitation with it.
I don't know whether the options below will scale for you but worth a shot and I would be super interested to learn which (if any) end up being suitable for you:
(I might be pushing it to consider Grafana as no-code)
Thanks for these links! Ultimately, what I want is something like Ninja Tables, or any of those WP plugins for tables, that can handle a fairly large dataset.
I simply want to have my csv dataset (that I can even manually format), import it, and be able to search and sort using a few categories.
Hey, Andrey from Sheet2Site is here.
You can make a table like sheet2site.com/templates/table and embed it to you your WordPress website. You can import CSV and use search and sorting.
You can quickly test how it will looks like by adding this code snippet into your website: https://sheet2site.com/#embed
Let me know if you need help.
Interesting! What is the maximum dataset size for these tables? Will it crash if I have 10k rows?
It's a good question. Let's try to make such table:
It's loading slowly (first it's loading first 267 rows and after the rest), but it's not crashing.
Search works also pretty slow.
I would probably split this dataset into groups and show each group in a subpage like yoursite.com/group1
Elasticsearch + Kibana might be a good fit. Also most obvious one Excel. Excel currently supports 1,048,576 rows.
Very interesting... I'm a bit intimidated by Elasticsearch + Kibana for my MVP. It sounds like something that I'd want to look at a bit down the road though.
Hey @sland
Have you tried looking into airtable.com and webflow.com?
You can create a website quite quickly that will be able to present the data.
Thanks! I looked at Airtable, but was turned off by their "records per base" limit of 50k for their top tier (unless I go Enterprise). I'll take another look at it and webflow too!
@antuis, @daveagill, @alistairtweedie, if you're curious what I ended up doing: I combined 22 csv files using a CMD prompt, manually sorted of the data in Excel to reduce the size of the table (removed entries with >2 review which left me with 9500 rows), imported it in Google Sheets where I cleaned it up a bit more, and presented it on my Wordpress site using Ninja Tables Pro. It's not elegant and won't scale, but it works for now....