Commit Graph

320 Commits

Author SHA1 Message Date
Leonid Pliushch
b5ab2097ae Fast build fixes (#3696)
* Do not re=download release files.

* Efficiently handle dependencies: do not try to download \*.deb files when they already downloaded, do not try to extract them more than one time.
2019-04-21 18:05:39 +03:00
Fredrik Fornwall
bfab2b63a9 cmake: Update from 3.13.4 to 3.14.2 2019-04-18 00:25:28 +02:00
Fredrik Fornwall
36e680b07d Adapt checksum for ninja-linux.zip 2019-04-18 00:12:24 +02:00
Fredrik Fornwall
aae8c39e8f Let rustup install rust 1.34 2019-04-17 22:42:55 +02:00
Leonid Pliushch
16aa9acb5d termux-elf-cleaner: update to v1.6
No changes if API level is >= 23.
2019-04-15 18:39:38 +03:00
Tom Yan
dab21ee7b7 zlib-dev: breaks and replaces old ndk-sysroot
also bump toolchain version for z{lib,conf}.h removal
2019-04-14 16:00:23 +03:00
Tom Yan
5170610f52 zlib: add package 2019-04-14 16:00:23 +03:00
Tom Yan
125c192664 build-package: fix conffiles for subpackages
conffiles was being created after control.tar.gz, which makes it
being omitted
2019-04-13 19:08:54 +03:00
Leonid Pliushch
8b2ae5b3e8 package_uploader.sh: handle licenses "custom" and "non-free" 2019-04-12 17:23:45 +03:00
Leonid Pliushch
53c9c845bf swi-prolog: specify necessary host tools in setup-ubuntu.sh 2019-04-09 18:57:29 +03:00
Leonid Pliushch
8f042ae6b3 build-package.sh: do not try to gzip manpages that are already gzipped
Avoid warning and broken symlinks.
2019-04-09 17:45:43 +03:00
Tom Yan
7bfe758c81 build-package: set CMAKE_FIND_ROOT_PATH_MODE_PROGRAM to NEVER 2019-04-09 14:23:24 +03:00
Fredrik Fornwall
c0d22ec7d1 golang: Update from 1.12.1 to 1.12.2 2019-04-07 22:44:13 +02:00
Tom Yan
4098976a2e buildorder.py: make subpackage pull its parent 2019-04-06 02:57:54 +03:00
its-pointless
59625ccecd llvm-8 and rust with back ports for llvm-8 2019-03-29 01:28:11 +02:00
Tom Yan
a57750848d build-package: add TERMUX_PKG_DEVPACKAGE_{BREAKS,REPLACES} support 2019-03-27 01:10:30 +08:00
Tom Yan
30f12fec65 buildorder.py: make fast build mode download all subpackages 2019-03-26 17:12:28 +02:00
Leonid Pliushch
5ec5a1a314 build-package.sh: fix printing of error message when trying to run script on Android device 2019-03-26 01:27:09 +02:00
Leonid Pliushch
3d0e516c64 termux_step_setup_toolchain.sh: simplify unneeded headers removal 2019-03-25 17:55:48 +02:00
Leonid Pliushch
9e682ab75f termux_step_setup_toolchain.sh: move 'rm usr/include/sys/capability.h' to correct place 2019-03-25 17:32:00 +02:00
Leonid Pliushch
512bcdbea5 package uploader: when script exit, return status code '1' if there errors occurred
package_uploader.sh should not exit on error when package processing is not finished
by allowing to do as much as possible.

But we need some mechanizm to notify maintainers when errors occurred on CI/CD
on package operations.
2019-03-25 16:43:30 +02:00
Leonid Pliushch
73c6e60c59 setup-ubuntu.sh: add lua5.3, needed by luarocks 2019-03-25 16:12:03 +02:00
Leonid Pliushch
4fbf09ac78 package uploader: fix checking of build.sh existence 2019-03-25 14:25:08 +02:00
Leonid Pliushch
214799a285 package uploader: omit messages on stderr when sourcing build.sh
Prevents messages like this one:
which: no msgfmt in (/home/xeffyr/bin:/run/wrappers/bin:/home/xeffyr/.nix-profile/bin:/nix/var/nix/profiles/default/bin:/run/current-system/sw/bin:/etc/profiles/per-user/xeffyr/bin)
2019-03-25 14:15:58 +02:00
Fredrik Fornwall
2b4652804f Remove sys/capability.h from the NDK sysroot
The sys/capability.h file will be provided by libcap-dev.
2019-03-24 23:15:44 +01:00
Tom Yan
bc217587fb build-package: handle -dev package download from buildorder.py 2019-03-23 17:31:40 +02:00
Tom Yan
ca475bf2be buildorder.py: only omit target's subpackage for fast build 2019-03-20 19:23:51 +02:00
Tom Yan
befdca1749 buildorder.py: parse TERMUX_PKG_DEVPACKAGE_DEPENDS 2019-03-20 19:23:51 +02:00
Leonid Pliushch
2ee99435a9 fast builds: enable downloading from game, root & science repositories 2019-03-20 17:27:33 +02:00
Leonid Pliushch
8742fc020d termux_step_setup_variables.sh: remove unneeded variable
Not needed after cada4be0d87bc4bf8559f08304d6051624d43737.
2019-03-20 03:41:36 +02:00
Leonid Pliushch
166f6e6e47 package uploader: fix conditional when checking http status after publishing in upload_package() 2019-03-20 03:39:35 +02:00
Leonid Pliushch
37259f0867 package uploader: fix variable name in upload_package() 2019-03-20 03:16:43 +02:00
Leonid Pliushch
2ea0b724aa fast builds: enable downloading from unstable and x11 repositories 2019-03-20 02:57:52 +02:00
Leonid Pliushch
81594bf062 package uploader: escape dot in versions when using grep 2019-03-20 01:37:03 +02:00
Leonid Pliushch
b0d006d10a package uploader: fix message in delete_old_versions_from_package() 2019-03-18 23:05:53 +02:00
Leonid Pliushch
89fdecc467 package uploader: do not require build.sh when deleting package 2019-03-18 23:04:47 +02:00
Henrik Grimler
619d8bba25 Merge pull request #3450 from tomty89/libc++
Simplify libc++ setup
2019-03-18 21:06:19 +01:00
Leonid Pliushch
b789ab46b1 package uploader: attempt to fix errors when using on CI 2019-03-17 13:04:59 +02:00
Leonid Pliushch
e42860a935 update package_uploader.sh
* A bit of refactoring.

* Cleanup mode - remove old package versions and keep only latest one on the remote.

* Metadata regeneration mode. Allows to regenerate metadata without package uploading.

* No script failure when package errored. Just show message and continue.

* Do not leave repository in inconsistent state when terminating uploader with ctrl-c.

* Prevent processing of the duplicated package names in arguments. Argument list will be also sorted.

* Compact informational messages.
2019-03-17 03:13:12 +02:00
Henrik Grimler
ed1cad9ce2 package_uploader: fix typo 2019-03-16 15:15:13 +01:00
Fredrik Fornwall
12ad4574aa golang: Update from 1.12 to 1.12.1 2019-03-15 14:53:10 +01:00
Leonid Pliushch
0d53b9abe1 package uploader: keep old versions currently, always replace deb files with same name
It seems that metadata generation take about 40 seconds.
If we submit a new version of package with deleting previous one, users
will observe 404 errors until new metadata will be published.
2019-03-13 17:53:07 +02:00
Leonid Pliushch
c091cdc962 termux-elf-cleaner: update to v1.5
Now it no longer removes GNU version sections.
2019-03-12 14:20:07 +02:00
Leonid Pliushch
391d0b2808 fast-build mode: use termux_download function for downloading 'Release'
Addition for cada4be0d87bc4bf8559f08304d6051624d43737.

Release file may not exist too when metadata generation is in progress,
so we may need to do several tries to download file.
2019-03-12 01:41:40 +02:00
Leonid Pliushch
4ce0e267d0 package uploader: skip packages with custom licenses
Try to detect packages with custom licenses and just skip them
so upload of other packages will be finished successfully.
2019-03-11 20:39:45 +02:00
Leonid Pliushch
9ca57fbef1 fast-build mode: do not rely on gpg when verifying metadata
If previous build create metadata generation job, the repository will be left in
unsigned state for up to 5-20 seconds. We cannot do anything with this as how
Bintray works. When this case happens, signature checks will fail causing build
failure.

See https://gitlab.com/termux-mirror/termux-packages/-/jobs/175356747.

For now, gpg checks are permanently disabled. When a better solution will be
found, feel free to revert this commit.
2019-03-11 18:04:56 +02:00
Leonid Pliushch
398192d4dc package_uploader.sh: check for dependencies before running 2019-03-11 16:00:56 +02:00
Leonid Pliushch
5a24ad3ee0 package_uploader.sh: use more generic bash path for shebang
Fixes error when trying to execute script on NixOS.
2019-03-11 15:55:32 +02:00
Tom Yan
596c8c85da Simplify libc++ setup
As clang++ in the NDK defaults to libc++ since r17, we no longer
need to fake a libstdc++.so at build time (and omit it from the
libc++ package we ship).
2019-03-11 16:33:12 +08:00
Fredrik Fornwall
77d5eb17cf Avoid meson stripping DT_RUNPATH
See #3490.
2019-03-10 23:58:37 +01:00
Fredrik Fornwall
e9d3fcea4c Fix DT_RUNPATH for rust-using packages
See #3490.
2019-03-10 23:33:24 +01:00
Fredrik Fornwall
73ec719d77 Set CGO_LDFLAGS="$LDFLAGS" for go packages
This should add DT_RUNPATH. See #3490.
2019-03-10 22:27:52 +01:00
Leonid Pliushch
2d66d967eb termux_step_setup_variables.sh: fix gpg keys 2019-03-10 21:46:41 +02:00
Leonid Pliushch
f195bf598d package uploader: improve searching of subpackages
Handle cases where package directory is actually symlink.
2019-03-10 15:47:43 +02:00
Leonid Pliushch
d22ac1b2fb fast-builds: switch to bintray url 2019-03-10 15:42:58 +02:00
Leonid Pliushch
d450e6af8f build-package.sh: create dummy libutil.so which links to libc
Replace libutil.so with linker script so we don't have to patch
each program that tries to link with libutil.so.
2019-03-10 15:42:58 +02:00
Leonid Pliushch
310e65e586 package uploader: add support for keeping previous versions, update help info, rename script 2019-03-10 15:41:38 +02:00
Leonid Pliushch
db159bdc3b add package uploading script
This script can be used either manually or by CI to
upload packages to Bintray.
2019-03-10 15:41:38 +02:00
Leonid Pliushch
c508560e40 build-package.sh: enable use of DT_RUNPATH, set minimal API level to 24 2019-03-10 15:41:38 +02:00
Henrik Grimler
5920f3dc5a termux_create_subpackages: support TERMUX_SUBPKG_BREAKS 2019-03-07 20:37:47 +01:00
Henrik Grimler
d30227669f build-package: mv code for creating subpackages to new file 2019-03-07 20:35:32 +01:00
Fredrik Fornwall
30c73290b6 go: Update from 1.11.5 to 1.12 2019-03-06 22:57:26 +01:00
Fredrik Fornwall
f488461a11 Merge pull request #3448 from Grimler91/jq
setup-ubuntu.sh: add jq and remove debdiff
2019-03-06 22:39:11 +01:00
Leonid Pliushch
44d28f9f88 build-package.sh: prevent parallel runs in the same environment
Avoid corruption of the build environment if build-package.sh was
executed in 2 parallel sessions.
2019-03-06 17:01:19 +02:00
Leonid Pliushch
9fe4647cda fast-builds: do not rely on bootstrap archives
Reasons:

 * they may contain outdated packages
 * they are redundant
 * they may not exist for target repository (e.g. if building for non-termux.net)
2019-03-06 16:04:08 +02:00
Henrik Grimler
69eb7a1299 setup-ubuntu.sh: add jq and remove debdiff 2019-03-04 22:08:56 +01:00
Leonid Pliushch
858c73d75a termux-elf-cleaner: update to v1.4
Provides fix for Android 5.
2019-03-04 14:58:10 +02:00
Leonid Pliushch
4d5adae680 update scripts for continuous integration
Keep bare minimum of scripts & configuration files for CI.

Set Travis target language to generic, remove 'Gemfile' and
'Rakefile' since we building *.deb packages and not ruby ones.
Code that determining changes in git repository is reimplemented
in bash.

Disabled packages are excluded from CI tracking as they frequently
cause errors.
2019-03-04 03:53:21 +02:00
Henrik Grimler
f6164ddd7e termux_download_deb: check that Packages exist before reading hash 2019-03-03 13:27:47 +02:00
Henrik Grimler
2273e3f2a2 build-package: stop build if buildorder.py returns error 2019-03-03 13:27:47 +02:00
Henrik Grimler
531956ce02 build-package: call termux_get_repo_files in termux_step start_build
Prevents unnecessary re-downloads of repo files.
2019-03-03 13:27:47 +02:00
Henrik Grimler
530eddf30a build-package: add new env. var. TERMUX_PACKAGES_DIRECTORIES
Can be set to the path to packages/ directories in other repos (like
unstable-package/packages/, termux-root-packages/packages/,
..). buildorder.py then searches these directories for packages and
dependencies
2019-03-03 01:40:22 +02:00
Henrik Grimler
10fdf172d5 build-package: download dependencies recursively when fast-building
Use scripts/buildorder.py with a new -i flag to get all dependencies
(including subpackages). The script now also spits out both package
name and package dir, to make it easier to build packages from another
repo.
2019-03-03 01:40:22 +02:00
Henrik Grimler
379f2452f3 build-package: remove termux_step_compare_debs 2019-03-03 01:40:22 +02:00
Fredrik Fornwall
bf564bde66 Use meson version 0.49.2 2019-03-01 23:32:15 +01:00
Fredrik Fornwall
73f4a8dbdb Use specific version when setting up rust
This makes for more reproducible builds.
2019-03-01 21:36:43 +01:00
Henrik Grimler
a5956bf91e termux_step_start_build: handle failed subpackage downloads
Build parent package instead of trying to build the subpackage.
2019-03-01 14:21:42 +02:00
Henrik Grimler
5f7c735734 termux_step_compare_debs: fix subpackage comparison 2019-02-28 01:50:53 +02:00
Henrik Grimler
67d79e8b92 build-package: mv termux_step_finish_build to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
90138a3a69 build-package: mv termux_step_compare_debs to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
8be8c3a2d6 build-package: mv termux_step_create_debfile to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
586e8709fd build-package: mv termux_step_create_datatar to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
a30a61d417 build-package: mv termux_step_massage to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
9f5ba4bcc6 build-package: mv termux_step_extract_into_massagedir to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
617764f4f4 build-package: mv termux_step_make_install to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
d0db5e647b build-package: mv termux_step_make to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
46f4e306fd build-package: mv termux_step_configure to scripts/build/configure/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
9e04fe1434 build-package: mv termux_step_configure_meson to scripts/build/configure/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
74f09e886b build-package: mv termux_step_configure_cmake to scripts/build/configure/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
0bb1da3146 build-package: mv termux_step_configure_autotools to scripts/build/configure/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
38d3f22377 build-package: mv termux_step_replace_guess_scripts to scripts/build 2019-02-27 21:59:08 +02:00
Henrik Grimler
5389a1a4e2 build-package: mv termux_step_patch_package to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
63fdeada9b build-package: mv termux_step_setup_toolchain to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
3e088d12f7 build-package: mv termux_step_extract_package to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
0b9109238a build-package: mv termux_step_start_build to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
68166e9b62 build-package: mv termux_step_get_repo_files to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
7ca66e6589 build-package: mv termux_download_deb to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
3e70f419a1 build-package: mv termux_extract_dep_info to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
8ae7c5ef86 build-package: mv termux_step_handle_buildarch to scripts/build/ 2019-02-27 21:59:08 +02:00
Henrik Grimler
063eaac334 build-package: mv termux_setup_variables to scripts/build/ 2019-02-27 21:59:08 +02:00