Commit Graph

144 Commits

Author SHA1 Message Date
Leonid Pliushch
a33bfe8acc
Revert "github actions: remove package_updates.yml (automatic updates)"
This reverts commit 468b4d4063.
2021-06-13 22:21:41 +03:00
Leonid Pliushch
c1971731f8
github actions: only upload packages specified in debs/built_packages.txt 2021-06-04 17:08:17 +03:00
Leonid Pliushch
b1c0480ea7
github actions: run ./build-package.sh with -I again 2021-06-04 00:34:22 +03:00
Leonid Pliushch
5923e26410
github actions: uploader message fix 2021-06-03 19:36:19 +03:00
Leonid Pliushch
62e458e507
github actions: fix repository publishing step 2021-06-03 18:35:51 +03:00
Leonid Pliushch
90a703a7f2
github actions: more complete error handling for uploads 2021-06-03 17:38:57 +03:00
Leonid Pliushch
101ae1396a
github actions: delete temporary directory from server if package upload failed 2021-06-03 16:56:10 +03:00
Leonid Pliushch
3ff64f973d
github actions: finally remove uploads to grimler.se
Shouldn't be needed anymore.
2021-06-03 15:52:57 +03:00
Leonid Pliushch
9104125493
github actions: provide gpg passphrase via secrets
No need to keep gpg-agent running on server side anymore.
2021-06-03 01:37:30 +03:00
Leonid Pliushch
b5bdfe3522
Revert "github actions: disable uploads to grimler.se"
This reverts commit bc0642e5d7.
2021-06-03 01:10:50 +03:00
Leonid Pliushch
bc0642e5d7
github actions: disable uploads to grimler.se
don't fill grimler.se with test packages
2021-06-03 01:00:02 +03:00
Leonid Pliushch
3155996cec
github actions: debugging package upload 2021-06-03 00:59:29 +03:00
Leonid Pliushch
2f63574e2b
github actions: initial support of uploading to packages.termux.org 2021-06-03 00:16:03 +03:00
Leonid Pliushch
719957fa2a
Revert "fix" for curl in Github Actions
It doesn't work.
2021-05-26 16:45:50 +03:00
Krishna Kanhaiya
ea9e0dde42
Github actions: Enable -I options again. 2021-05-26 09:09:22 +05:30
Jia Yuan Lo
391c5a2876 Fix for curl timeout in GitHub Actions 2021-05-26 09:07:25 +05:30
Leonid Pliushch
0287e528ff
github actions: do not use option '-I' for build-package.sh again
Maybe really switch Cirrus CI if Github Actions can't provide normal networking?

This reverts commit c17ea7ff1b.
2021-05-19 16:51:37 +03:00
Leonid Pliushch
c17ea7ff1b
Revert "github actions: do not use option '-I' for build-package.sh"
This reverts commit 96b4e572d6.
2021-05-18 22:46:49 +03:00
Henrik Grimler
e62c896722 workflows: re-structure upload job
To try to fix job error.
2021-05-15 22:54:45 +02:00
Henrik Grimler
692bc9429e workflows: fix forgotten parameter in packages.yml 2021-05-15 22:33:15 +02:00
Henrik Grimler
9f44c4f496 workflows: do not error on upload step if there are no debs
As is the case when using ci:no-build for example.
2021-05-15 22:25:17 +02:00
Leonid Pliushch
96b4e572d6
github actions: do not use option '-I' for build-package.sh
Connections to apt repositories often stuck, cause builds to time out.
As there no issues on repository side and connection problem is reproducible
only on Github Actions instances, I can only assume that there is either a
some bug in CI virtual machines setup or Github applies undocumented(?)
limits on networking usage.

Removing '-I' option will disable downloading of prebuilt dependencies
and thus networking usage at cost of increased build times.
2021-05-06 19:31:27 +03:00
Leonid Pliushch
cbdd1cf4c7
CI: revert changes to Docker workflow.
Credentials were removed from repository secrets and that's why login doesn't
work.

This reverts commit c4e244effc.
This reverts commit c8988499dc.
2021-03-29 17:49:37 +03:00
Leonid Pliushch
c4e244effc
CI: remove quotes for credentials in Docker image workflow 2021-03-29 17:46:49 +03:00
Leonid Pliushch
c8988499dc
CI: update workflow for Docker image
Try to supply credentials a bit differently.
2021-03-29 17:25:50 +03:00
Leonid Pliushch
245d0a32d8
CI: free even more space
Now we should have >60 GB free on rootfs.
2021-03-28 23:09:49 +03:00
Leonid Pliushch
e214ccdee4
CI: free more space 2021-03-28 23:00:11 +03:00
Leonid Pliushch
2b07eeaaed
github actions: termux-packages uses ./scripts/run-docker.sh instead of ./start-builder.sh 2021-03-02 15:18:53 +02:00
Henrik Grimler
f36b4a5ac2
github actions: print subpackages to built_packages.txt as well (#6469)
But only (try to) build the main packages. For each modified package
we check if there are subpackages and in that case save them in
built_packages.txt as well, so that the repository server does not
have to parse the git repo to find out if there are subpackages.
2021-03-01 08:52:25 +01:00
Leonid Pliushch
8487bd8018
bintray repository is now in archive mode
Even though JFrog continued Bintray normal operation until 31 Mar 2021, I'm
disabling Github Actions uploads now. Termux Bintray repository continues to
be available in read-only mode until the final shutdown by JFrog.
2021-02-28 18:15:46 +02:00
Leonid Pliushch
fa47b40bb7
github actions: append commit hash to artifacts archive name (#6450) 2021-02-25 13:05:07 +01:00
Leonid Pliushch
95153d0052
github actions: shouldn't be necessary to re-download artifacts
This is already done at the beginning of upload task.
2021-02-24 23:53:40 +02:00
Leonid Pliushch
47a95b59f6
github actions: append git commit hash to artifacts archive name 2021-02-24 23:52:17 +02:00
Henrik Grimler
de2729bc3f packages.yml: append random suffix to archive
To not override previous archives that might not have been parsed yet.
2021-02-23 22:18:38 +01:00
Henrik Grimler
3ede21be70 CI: upload debs to grimler.se as well
Will turn off the bintray mirroring for grimler.se once I confirm (as
well as I can) that this works as intended. Will upload a wiki page
with some information about how this is set up on the server in case
someone wants to make a similar setup.

Also use v2 for upload- and download-artifact.
2021-02-14 16:34:26 +01:00
Leonid Pliushch
95e98e8e95
github actions: remove repology metadata workflow 2021-02-11 21:15:03 +02:00
Leonid Pliushch
9113607bac
github actions: disable whatprovides database update
Bintray returns "405 Not Allowed" and is deprecated anyway.
2021-02-09 15:18:07 +02:00
Leonid Pliushch
468b4d4063
github actions: remove package_updates.yml (automatic updates)
Begin phasing out dl.bintray.com/termux/termux-packages-24.

Before Bintray will go read-only (28 Feb), we need to ensure that
its repo has consistent state and no/minimal amount of issues as
large amount of users will continue to use it until Bintray finally
go down.

I still leaving autobuild/autodeploy (packages.yml) to Bintray repo
to process all remaining updates or pull requests with for short time.
2021-02-08 18:15:57 +02:00
Leonid Pliushch
980500a2f7
CI: update-whatprovides-db: exit if ./debs directory is empty 2021-01-07 14:29:30 +02:00
Leonid Pliushch
fe6d6d4044
add manual Github Actions workflow for regenerating apt lists
Equivalent of `./scripts/package_uploader.sh --regenerate` which needs
admin credentials for apt repo.
2021-01-03 00:05:00 +02:00
buttaface
4e6ca12500
CI: free more disk space in the VM 2020-12-21 17:40:07 +02:00
Leonid Pliushch
2aed379af2
CI: package updates: use my token for cloned repo 2020-12-18 00:26:53 +02:00
Leonid Pliushch
6ab6ffa865
CI: fetch all commits in package_updates.yml 2020-12-18 00:07:12 +02:00
Leonid Pliushch
ae12994deb
CI: allow to purge old debfiles manually 2020-12-17 23:55:34 +02:00
Leonid Pliushch
19fec71992
CI: allow to regenerate Repology metadata manually 2020-12-17 23:54:49 +02:00
Leonid Pliushch
bddfd7da4d
CI: allow to trigger Docker image rebuild manually 2020-12-17 23:54:17 +02:00
Leonid Pliushch
8fec9045fd
CI: run package updates every 6 hours 2020-12-17 23:52:50 +02:00
Leonid Pliushch
5dfac1d75b
CI: allow workflow 'package updates' to be triggered manually 2020-12-17 23:50:16 +02:00
Leonid Pliushch
a182182d8e
CI: allow to push updates 2020-12-17 23:44:44 +02:00
Leonid Pliushch
61e23dd6c6
CI: experimental support for automatically checking updates, building them and committing
No push to main repo is performed currently.
2020-12-17 22:24:13 +02:00
Leonid Pliushch
a531f0da37
CI: add workflow for check-updates.sh
For now script will just check package updates each 6 hours and print
them to console. Nothing will be built/pushed.

Functionality will be extended gradually.
2020-12-17 16:36:08 +02:00
Leonid Pliushch
fa4fe9b8d8 CI: add task for updating Whatprovides database with new deb files 2020-11-21 21:12:00 +02:00
Leonid Pliushch
4101b7ff55 CI: disable cacheing - unreliable
Warning: Cache service responded with 429 during upload chunk.
/home/runner/work/_actions/actions/cache/v2/dist/save/index.js:3305
                        throw new Error(`Cache upload failed because file read failed with ${error.message}`);
                        ^

Error: Cache upload failed because file read failed with EBADF: bad file descriptor, read
    at ReadStream.<anonymous> (/home/runner/work/_actions/actions/cache/v2/dist/save/index.js:3305:31)
    at ReadStream.emit (events.js:210:5)
    at internal/fs/streams.js:167:12
    at FSReqCallback.wrapper [as oncomplete] (fs.js:470:5)
2020-11-09 00:25:43 +02:00
Leonid Pliushch
aac8319561 CI: attempt caching with "restore-keys"
According to docs, option "restore-keys" support partial cache key
matching which should allow to download prebuilt debs saved in previous
build.
2020-08-04 00:22:44 +03:00
Leonid Pliushch
026350a838 Revert "CI: cache downloaded dependency debfiles"
Github Actions do not allow to overwrite already stored cache for
specific key. This caching approach is suitable for projects, where
dependencies are being tracked within lock files or their alternatives,
for exapmle NPM, Ruby or Python. Termux-packages is not such repository
where we can easily retrieve cache by using old key and generate a new
one after building was finished.
2020-08-04 00:02:53 +03:00
Leonid Pliushch
5a323bb93a CI: cache downloaded dependency debfiles
https://github.com/termux/termux-packages/issues/5620
2020-07-31 16:08:53 +03:00
Leonid Pliushch
5cf235d936 CI: revert latest changes, attempt to fix step 'Free additional disk space on host' 2020-07-01 20:29:38 +03:00
Leonid Pliushch
41c529fd8c Revert "CI: switch to Ubuntu 20.04 and don't use Docker image as build environment"
This reverts commit eaeb2e609e075adea6c3d783a258996517a83ac5.
2020-07-01 20:27:59 +03:00
Leonid Pliushch
39c66b1ea7 Revert "CI: don't use run-docker.sh"
This reverts commit 7aeb7a9a3ab57676776020c35513924d4d1f3472.
2020-07-01 20:27:50 +03:00
Leonid Pliushch
1bb3746c24 Revert "CI: do not hardcode paths to NDK/SDK"
This reverts commit fbf070084bef34e6c0f565c81f3d05fbc0cb1dc8.
2020-07-01 20:27:41 +03:00
Leonid Pliushch
a7fa64f3d7 Revert "CI: setup NDK/SDK"
This reverts commit 968e85067c09a81ea4f61969849ce2fc77991584.
2020-07-01 20:27:34 +03:00
Leonid Pliushch
104255b4fe CI: setup NDK/SDK 2020-07-01 20:00:14 +03:00
Leonid Pliushch
97a8171aa9 CI: do not hardcode paths to NDK/SDK 2020-07-01 17:38:20 +03:00
Leonid Pliushch
f352387fe2 CI: don't use run-docker.sh 2020-07-01 14:55:45 +03:00
Leonid Pliushch
3d3868cf60 CI: switch to Ubuntu 20.04 and don't use Docker image as build environment
Note that ubuntu-20.04 is preview currently, as stated in https://help.github.com/en/actions/reference/virtual-environments-for-github-hosted-runners.
2020-07-01 14:48:24 +03:00
Leonid Pliushch
5bdcbbd714 CI: fix creation of empty artifacts archive when %ci:no-build is set 2020-06-02 20:42:02 +03:00
Leonid Pliushch
1d43d0981e CI: an attempt to prevent failure of upload job when %ci:no-build tag is specified
%ci:no-build causes packages not being built, however it doesn't prevent
artifacts from being uploaded/downloaded. Due to unavailable *.deb files,
upload job fails during download of the artifacts archive.

Placeholder file should make a valid artifact archive to be available so
job will not fail anymore.
2020-06-02 20:25:36 +03:00
Leonid Pliushch
eaffc65498 Revert "CI: temporary enable repology metadata updating on pushes for testing"
This reverts commit dab78baa6a07dbbcc27c5189c3c0f86efe76b2a8.
2020-05-11 22:23:22 +03:00
Leonid Pliushch
6d52e0e37a CI: delete & create version instead of updating file for repology metadata
Bintray allows version modification only during 365-day period.
2020-05-11 22:19:31 +03:00
Leonid Pliushch
c021c4be50 CI: print curl response for repology metadata 2020-05-11 22:04:34 +03:00
Leonid Pliushch
b571848b66 CI: temporary enable repology metadata updating on pushes for testing 2020-05-11 22:01:52 +03:00
Leonid Pliushch
d41e45e53c CI: do not exit if metadata deletion failed 2020-05-11 21:59:37 +03:00
Leonid Pliushch
dc2fc13379 CI: specify interpreter in repology script call 2020-05-11 16:49:36 +03:00
Leonid Pliushch
922c90d7ba CI: introduce weekly rebuilds of docker image
Docker image will be built & pushed every 7 days to ensure that
its packages are up-to-date.
2020-05-02 15:27:36 +03:00
Leonid Pliushch
bdc7322307 CI: show checksums for built debs 2020-03-12 19:02:27 +02:00
Leonid Pliushch
4c1caf17e6 Revert "CI: do not uninstall java from VM"
This reverts commit 37abc307c57a7cbe3f456b6b483943334eb1b837.
2020-03-08 21:26:57 +02:00
Leonid Pliushch
6804040afa CI: do not uninstall java from VM
Should fix https://github.com/termux/termux-packages/pull/4845/checks?check_run_id=490861673 ?
2020-03-06 21:07:13 +02:00
its-pointless
eada913048 rust-1.41.1 (#5009)
* Update rust to 1.41.1
* CI: free additional space in VM, otherwise Rust v1.41.1 build will fail
2020-03-06 13:20:17 +02:00
Leonid Pliushch
d26c673109 CI: update packages.yml
Properly handle cases where we have both updated & deleted packages.
2020-02-23 13:51:30 +02:00
Leonid Pliushch
f426dbe994 CI: ensure that directories ./debs and ./artifacts are always available
Even if '%ci:no-build' tag was applied.
2020-02-17 13:33:59 +02:00
Leonid Pliushch
a5699b620a CI: handle commit tag '%ci:no-build'
This tag will force current workflow to exit with status 'passed'.
2020-02-17 13:13:32 +02:00
Leonid Pliushch
0228ec2a86 CI: fix job name in repository_cleanup.yml 2020-02-06 21:10:54 +02:00
Leonid Pliushch
ae9856e038 CI: add script for automatic old versions cleanup
Expected to be automatically started at 02:00 every day. Will
go through all packages and remove versions that are no longer
needed.

Experimental, may cause metadata inconsistency until process is
finished.
2020-02-04 14:52:26 +02:00
Leonid Pliushch
bb8d3acd48 CI: update workflows/packages.yml 2020-01-25 16:39:24 +02:00
Leonid Pliushch
2fc2cc5675 CI: fix incorrect *.deb file transfer between jobs
Should fix the issue where updating is done only for
deb files from the last finished build job.
2020-01-23 23:25:15 +02:00
Leonid Pliushch
9e97a520e4 CI: allow to use customized Docker image
Necessary to handle cases where setup scripts were changed
during push or pull request.
2020-01-23 22:36:04 +02:00
Leonid Pliushch
b6c59df765 CI: use termux/package-builder Docker image as build environment 2020-01-23 21:54:42 +02:00
Leonid Pliushch
c4d673ee07 CI: set path to where extract downloaded artifacts 2020-01-23 00:05:16 +02:00
Leonid Pliushch
0d2a5f69bc CI: workaround for possible artifact upload failure
Certain symbols in file name may cause problems, so directory ./debs
will be archived in tar before uploading.
2020-01-22 23:56:05 +02:00
Leonid Pliushch
c1601eab70 CI: fix typo in schedule for repology_metadata.yml 2020-01-22 23:29:25 +02:00
Leonid Pliushch
b447efc27e CI: try to avoid failure when package lists are not found 2020-01-22 22:55:19 +02:00
Leonid Pliushch
50b370d31a CI: lint packages before building 2020-01-22 22:49:57 +02:00
Leonid Pliushch
b7611b8fc0 CI: do not treat usernames/logins as secrets
This causes logging issues where certain words like 'termux'
are censored. This breaks directory paths & urls.
2020-01-22 22:41:34 +02:00
Leonid Pliushch
c087460476 CI: setup Github Actions 2020-01-22 21:51:12 +02:00