feat: add s3 file storage implementation (#10526)

* Beginning cherry-pick of changes

* more updates

* Add local and s3 storage services, modified base storage service, delegate from langflow to lfx

* more change

* remove all instances of with session

* test s3

* add tests and fix fe

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* fix diamond inheritance and some flush / reset db patterns

* [autofix.ci] apply automated fixes

* Add methods for injectable session scopes

* user run_until_complete for some async calls

* [autofix.ci] apply automated fixes

* Fix csv and json to data components

* Fix some imports and add s3_comp and local-storage_serv testing

* Fix test paths

* more test fixes

* Import and test fixes

* fix remaining s3 compo tests

* Fix langchain compatibility versions

* Fix json/csv agent test mocks

* Fix base file reads with structured output path

* re-add lock

* Add safety around file streaming gen

* [autofix.ci] apply automated fixes

* comment

* improve error handling for file deletion

* abstract reads to storage utils

* [autofix.ci] apply automated fixes

* remove unnecessary deps

* fix lint issues

* fix byte stream generator call in download_file function

* Add import error handling for langchain dependencies in CSV and JSON agent components

* Add pypdf as a dependency in both uv.lock and pyproject.toml files

* ruff

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* fix test patches

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* [autofix.ci] apply automated fixes (attempt 3/3)

* Add noop database service and fix tests to utilize that

* comp index

* mock the imports more but not sure if that's the best soln

* ruff

* [autofix.ci] apply automated fixes

* uses commit in test since it yields

* [autofix.ci] apply automated fixes

* Fix prof pic test

* update prof pic size to fix test?

* ruff

* update lockfile

* update comp index

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes (attempt 2/3)

* use full path to altk test import

* update lockfile. again?

* Marks json test to allow a task leak, allowing since deprecated component

* [autofix.ci] apply automated fixes

* use lockfile from main to temporarily bypass issues with altk

* Update component build index

* [autofix.ci] apply automated fixes

* Fix conftest session scope usage?)

* Fix conftest yields

* lockfile

* [autofix.ci] apply automated fixes

* Fix another test session patterns

* Fix test type

* ruff

* [autofix.ci] apply automated fixes

* [autofix.ci] apply automated fixes

* Update s3.py

* [autofix.ci] apply automated fixes

* Document the append param

* [autofix.ci] apply automated fixes

* Update test_s3_endpoints.py

* [autofix.ci] apply automated fixes

* add back dep import script

* mock fixes

* fix save file tests

* [autofix.ci] apply automated fixes

* Flush after delete in upload_user_file

* use current path in loop csv test

* ruff

* ruff

* Updates the sqlite pragma test to use sqlite3 directly

* ruff

* ensure pragma test db is in wal mode

* Adds back some relevant tests

* ruff

* Add more integration s3 tests

* ruff

* component index

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Gabriel Luiz Freitas Almeida <[email protected]>
Co-authored-by: Eric Hare <[email protected]>