You'd typically go for an orchestrator like Airflow or Kestra, which gives you orchestration state.

This will enable you to run incremental batches or do structured backfilling.

Another option would be to use a data loading framework like dlt, which will also do the same but even more light weight (without the orchestration part, you write your batch flow logic in it).