169 Commits

Author SHA1 Message Date
Jirka Borovec
34140c0603 move lightning_app >> lightning/app (#16553)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-02-01 06:29:16 +01:00
Carlos Mocholí
dc298f2340 Drop support for Python 3.7 (#16579)
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2023-02-01 01:36:42 +00:00
Carlos Mocholí
a78412f11d Remove DataLoader serialization (under fault tolerance) (#16533) 2023-01-30 16:12:01 +01:00
Jirka Borovec
c8c47227df store: adding group-check (#16528) 2023-01-27 14:01:06 +00:00
Jirka Borovec
c3a9bf0419 ci: trigger on action edit (#16514) 2023-01-26 15:59:10 +01:00
Adrian Wälchli
c68cfd686e Rename LiteMultiNode to FabricMultiNode (#16505) 2023-01-26 11:36:27 +00:00
Jirka Borovec
f812cb8339 ci: move Flagships to GH (#16420)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-01-26 09:28:30 +00:00
Carlos Mocholí
d65006ed21 Update labeleler config (#16491) 2023-01-25 13:14:42 +01:00
Jirka Borovec
799ced8430 ci: replace flake8 by ruff (#16433)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-01-19 11:48:28 -05:00
Carlos Mocholí
5aa0a122d1 Fix broken link (#16442) 2023-01-19 17:37:56 +01:00
Jirka Borovec
c2c363d7ca rename integrations_app for accommodating flagships (#16345) 2023-01-12 10:13:52 -05:00
Carlos Mocholí
c18a0ec819 Remove untested NVIDIA Dali example (#16306) 2023-01-10 14:11:08 +01:00
Jirka Borovec
669ecff915 rename integrations (#16312)
* rename integrations

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* name

* Artifact

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2023-01-10 13:52:01 +01:00
Jirka Borovec
3326e65bb2 Update CI to CUDA 11.7.1 (#16123)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2023-01-04 22:44:23 +00:00
Carlos Mocholí
15ef52bc73 Rename LightningLite to Fabric (#16244)
* Rename LightningLite to Fabric

* Fix introspection test

* Fix deprecated Lite tests

* Undo accidental Horovod removal

* Fixes
2023-01-04 10:57:18 -05:00
Jirka Borovec
a203b043cb CI: settle file names (#16098)
* CI: settle file names

* rename

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2022-12-19 12:18:38 -05:00
Jirka Borovec
18a463808c CI: clean install & share pkg build (#15986)
* abstract pkg build
* share ci
* syntax
* Checkgroup
* folders
* whl 1st
* doctest

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-12-13 06:55:39 +01:00
Carlos Mocholí
9a778fc659 Fix pip install with no PACKAGE_NAME or editable mode (#15853)
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-12-11 23:01:06 +00:00
Carlos Mocholí
cca343267c Checkgroup config fixes (#15787) 2022-11-26 01:16:48 +00:00
Jirka Borovec
952b64b358 tests: split examples and pytests (#15774)
split examples and pytests
2022-11-23 20:15:16 +09:00
Jirka Borovec
59fa32080d Tests/App: refactor examples - structure (#15770)
* rename _examples dir

* refactor

* clean

* path

* add inits

* skip

* e2e

* azure

* e2e

* rev

* unify single depth for ignore docs req.

* group
2022-11-22 14:04:29 -05:00
Ethan Harris
bc797fd376 [App] Fix multi-node pytorch example CI (#15753) 2022-11-21 16:02:30 +00:00
Carlos Mocholí
80e7538379 Enable Probot CheckGroup v4 (#15649) 2022-11-16 11:07:02 +01:00
Jirka Borovec
57ac5483a0 Upgrade CI to PyTorch 1.13 (#15403)
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-12 23:39:23 +00:00
Adrian Wälchli
e87c11a592 Upgrade GPU CI to PyTorch 1.13 (#15583)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Jirka <jirka.borovec@seznam.cz>
2022-11-12 14:58:37 +00:00
Carlos Mocholí
a3edbec501 Delete unused TPU CI files (#15611)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-11 18:30:02 +00:00
Carlos Mocholí
1954764c4a Refactor checkgroup to avoid duplicated checks (#15633)
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Jirka Borovec <6035284+Borda@users.noreply.github.com>
2022-11-11 16:38:09 +00:00
Carlos Mocholí
6ba00af1e0 Drop PyTorch 1.9 support (#15347)
* Drop 1.9

* Everything else

* READMEs

* Missed some

* IPU skips

* Remove exception type

* Add back
2022-11-10 08:59:13 -05:00
Adrian Wälchli
2076746238 Update Lightning Lite examples (#15599)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-10 04:16:46 -05:00
Jirka Borovec
175603ca3f Merge the slow and regular test workflows (#15331)
* extend matrix

* drop

* group-check

* groups

* cat

* typo

* cat2type

* cat2type

* env vars

* ''

* Rename to slow. Fix timeout

* Examples are GPU only

* str

* Extra step

* ''

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-08 10:00:08 -05:00
Carlos Mocholí
3ea8903a32 Fix which groups require docs builds (#15581) 2022-11-08 13:14:17 +01:00
Carlos Mocholí
f392180c38 Do not modify PACKAGE_NAME on install (#15493)
* Do not modify PACKAGE_NAME on install

* Fix ci pkg action

* Required

* Typos

* Apply suggestions from code review

* Undo defaults

* Cleanup

* Implement idea

* Fuck

* Apps mock fix

* Fix app-pytest with PKG_NAME=app

* Justus suggestion

* Debug Windows

* Update setup.py

Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>

* Revert "Debug Windows"

This reverts commit 9fe3ba3665.

* SSH action

* Crazy bug

* Revert "SSH action"

This reverts commit 5061e8e7d6.

* Package import step

* Avoid env conflict

* Debug

* Whitespace

* Try removing existing lite build

* This should be redundant now

* Add back env now that source-lit is gone

* Remove download artifact

* checkgroup

* TODOs suggested by Jirka

* _

* Revert "_". These are local variables, do not need protected

This reverts commit 8340b85991.

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Adrian Wälchli <aedu.waelchli@gmail.com>
2022-11-04 17:51:03 +01:00
Jirka Borovec
8d802c5824 Add check groups for specific workflow changes (#15503)
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-11-03 13:42:54 +01:00
Jirka Borovec
1703944a1c CI: filter mypy triggers (#15481)
* CI: filter mypy triggers

* Fixes to checkgroup

* Remove setup.cfg

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2022-11-03 08:29:20 +01:00
github-actions[bot]
6d9efbe4f0 Adding test for legacy checkpiont created with 1.8.0 (#15450)
* [create-pull-request] automated change

* Add legacy to checkgroup

Co-authored-by: akihironitta <akihironitta@users.noreply.github.com>
Co-authored-by: Akihiro Nitta <nitta@akihironitta.com>
2022-11-01 16:47:17 +00:00
Jirka Borovec
30d5665f46 CI: trigger PL for lite (#15402) 2022-10-31 14:48:39 +00:00
Carlos Mocholí
6b8f394001 App tests hang on Windows with Python 3.9 (#15385)
App tests hang on Windows with Python 3.8
2022-10-28 13:01:55 +02:00
Carlos Mocholí
53ee014bf1 Create required group for app examples (#15332) 2022-10-28 11:20:30 +02:00
Jirka Borovec
9b35079c36 docker: drop pt 1.9 (#15345)
* docker: drop pt 1.9

* Missed some

* Last one

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2022-10-27 18:17:36 +02:00
Jirka Borovec
95ae393ca8 LAI: creating mirror package (#15105)
* placeholder

* mirror + prune

* makedir

* setup

* ci

* ci

* name

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci clean

* empty

* py

* parallel

* doctest

* flake8

* ci

* typo

* replace

* clean

* Apply suggestions from code review

* re.sub

* fix UI path

* full replace

* ui path?

* replace

* updates

* regex

* ci

* fix

* ci

* path

* ci

* replace

* Update .actions/setup_tools.py

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>

* also convert lightning_lite tests for PL tests to adapt mocking paths

* fix app example test

* update logger propagation for PL tests

* update logger propagation for PL tests

* Apply suggestions from code review

* Revert "update logger propagation for PL tests"

This reverts commit c1a5e119c7.

* playwright

* py

* update import in tests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* try edit import in overwrite

* debug code

* rev playwright

* Revert "try edit import in overwrite"

This reverts commit c02f766521.

* ci: adjust examples

* adjust examples cloud

* mock lightning_app

* Install assistant dependencies

* lightning

* setup

* Apply suggestions from code review

* Apply suggestions from code review

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>

* Apply suggestions from code review

* disable cache

* move doctest to install

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* )

* echo ./

* ci

* lru

* revert disabling cache, prints

* ci

* prune ci jobs

* prune ci jobs

* training loop standalone tests

* add sys modules cleanup fixture

* make use of fixture

* revert standalone

* ci e2e

* fix imports in lightning

* fix imports of lightning in tests

* Revert "make use of fixture"

This reverts commit c15efdd205.

* Revert other commits for fixtures

* revert use of fixture

* py3.9

* fix mocking

* fix paths

* hack mocking

* docs

* Apply suggestions from code review

* rev suggestion

* Minor changes to the parametrizations

* Update checkgroup with the new and changed jobs

* include frontend dir

* cli

* fix imports and entry point

* Revert standalone

* rc1

* e2e on staging

* Revert "Revert standalone"

This reverts commit 9df96685b8.

* groups

* to

* ci: pt ver

* docker

* Apply suggestions from code review

* Copy over changes from previous commit to other groups

* Add back changes from bad merge

* Uppercase step name everywhere

* update

* ci

* ci: lai oldest

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Justus Schock <12886177+justusschock@users.noreply.github.com>
Co-authored-by: Justus Schock <justus.schock@posteo.de>
Co-authored-by: manskx <ahmed.mansy156@gmail.com>
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
Co-authored-by: thomas chaton <thomas@grid.ai>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2022-10-27 12:32:49 +02:00
Carlos Mocholí
02074f16c7 Fix PyTorch versions in Lite CI (#15338)
* replace oldest in lite

* Fix PyTorch versions in Lite CI

* This will be moved to install pkg workflow in the mirror PR

* 1.13 fixes

* Windows fix

* sorting

Co-authored-by: otaj <ota@lightning.ai>
Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
2022-10-26 15:09:08 -04:00
Carlos Mocholí
54e76683fa Drop "full" suffix in CI (#15320) 2022-10-26 16:24:16 +02:00
Carlos Mocholí
102685c3ab Remove non-existent Lite checks (#15325) 2022-10-26 13:19:20 +02:00
Carlos Mocholí
e0f6db7ec3 Fix typo in OS name (#15318) 2022-10-26 10:41:41 +02:00
Carlos Mocholí
8b4d71c93f Update pl CPU testing matrix (#15312)
* Update pl CPU testing matrix

* Remove standalone comment, could be confused

* Heurisitc for PyTorch latest

* partition rest

* ckpgoup

* These do not exist

* This ALSO does not exist
2022-10-25 15:18:16 -04:00
Jirka Borovec
9c2164a1ad Run all tests in master (#15288)
* example full tests on master

* Modify checkgroup

Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
2022-10-25 12:34:04 -04:00
Carlos Mocholí
46639c693f Extend Lite CPU coverage (#15279) 2022-10-24 19:06:18 +00:00
Jirka Borovec
59c65db81c Ci: fix install pkg name (#15259)
* Ci: fix install pkg name

* param
2022-10-24 08:46:45 +02:00
Jirka Borovec
aa092a5db0 CI: testing monolotic package (#15213)
testing monolithic package
2022-10-23 08:53:58 +02:00
Carlos Mocholí
375ab53861 Migrate TPU tests to GitHub actions (#14687)
* Migrate TPU tests to GitHub actions

* No working dir

* Keep _target

* Dont skip draft

* CHECK_SLEEP

* Not yet

* Remove recurrent cleanup script

* Set secrets

* a step cannot have both the `uses` and `run` keys

* Version $PYTHON_VER was not found in the local cache

* can't load package ... ($GOPATH not set)

* The `set-env` command is disabled

* Try updating go

* Match timeout

* simplify path

* More cleanup

* Install coverage. Unmark draft

* Update .github/workflows/ci-pytorch-test-tpu.yml

* DEBUG echo

* Revert "DEBUG echo"

This reverts commit 4011856e6e.

* More debug

* SSH

* Im stupid

* Remove always()

* Forgot some

Co-authored-by: Jirka Borovec <Borda@users.noreply.github.com>
Co-authored-by: Luca Antiga <luca.antiga@gmail.com>
2022-10-21 20:01:39 +02:00