So many think they (their company) have “Big Data” but don’t. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		pjot on Dec 15, 2024 \| parent \| context \| favorite \| on: Should you ditch Spark for DuckDB or Polars? So many think they (their company) have “Big Data” but don’t.

bdcravens on Dec 15, 2024 [–]

My employer's product database is about 2TB currently and is still perfectly manageable with a single machine, and to be honest, it's not even all that optimized.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact