Commit Graph

143 Commits

Author SHA1 Message Date
Hiroshi Miura
bbb39c0847 Use concurrent.futures for concurrency with thread and process (#87)
Use concurrent.futures for multiprocessing and other improvements
- combination with thread pool for downloading and  process pool for extraction.
- Iterate all download and start extraction.
- Start extraction when download completed
- Add download completion log
- log a time  when extraction done
- Show elasped time for installation
- Meature elasped time
  * use perf_counter() for a total elapsed time.
  * use process_time() for individual extractions.

Signed-off-by: Hiroshi Miura <miurahr@linux.com>

* fix format specifier

Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2020-02-11 10:42:46 +09:00
Hiroshi Miura
7148599017 Default to use internal extraction (#80)
* Default to use py7zr
* Bamp up required py7zr >=0.5b5
* Drop --internal cli option

Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2020-01-11 00:51:25 +09:00
Hiroshi Miura
97e9af09b3 Revert mirror selection to original
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-11-29 21:01:24 +09:00
Hiroshi Miura
fbf413be50 Improve mirror handling
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-11-24 21:56:41 +09:00
Hiroshi Miura
48660900e3 Use settings module for blacklisting
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-11-24 12:55:51 +09:00
Hiroshi Miura
17402cdde5 update qconfig.pri licheck (#58)
Fix #57

Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-11-17 20:51:41 +09:00
Hiroshi Miura
a26f841882 Require py7zr only for py>3.5
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-11-16 20:11:33 +09:00
Hiroshi Miura
0363599359 Change install path (#48) (#49)
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-11-10 13:25:46 +09:00
Hiroshi Miura
e937dff283 Add CI test for tool installation (#47)
* Test: Update target Qt versions
* Add tools test
* tools: fix errors

Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-10-08 09:26:24 +09:00
Hiroshi Miura
b6a294df0d PEP8
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-10-07 14:16:42 +09:00
Hiroshi Miura
346f2ce436 Experimental implementation for tools installer
- command line
  `python -m aqt tools tools_ifw windows desktop qt.tools.ifw.31`

Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-10-07 14:11:24 +09:00
Hiroshi Miura
380f4a1948 Fix uninitialized variable use
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-10-04 17:08:56 +09:00
Hiroshi Miura
e8de2e7869 Add MANIFEST.in for distributing logging.yml
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-09-28 16:23:47 +09:00
Hiroshi Miura
886376d81b Add logging argument options
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-09-28 11:41:53 +09:00
Hiroshi Miura
7b1430fb39 Allow redirection on connection to mirror
fixed #41
2019-09-25 09:19:25 +09:00
Hiroshi Miura
4fa64b9f5d Use py7zr for extracting package 7z archive
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-06-04 09:52:20 +09:00
Hiroshi Miura
a7c56c87b7 Support installarion of mingw runtime
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-06-02 13:47:48 +09:00
Hiroshi Miura
6717aef6fa PEP8
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-06-02 10:17:06 +09:00
Hiroshi Miura
375fc81b7b Revert "Add more 7zip command option"
This reverts commit 9434873194.
2019-06-02 00:24:14 +09:00
Hiroshi Miura
0f54aa24b8 fix missing import
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-06-01 23:57:23 +09:00
Hiroshi Miura
9434873194 Add more 7zip command option
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-06-01 23:53:05 +09:00
Hiroshi Miura
44ec371c96 Always check miror site list for target
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-06-01 23:52:13 +09:00
Hiroshi Miura
a56933637f Refactoring metalink class
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-06-01 17:40:34 +09:00
Hiroshi Miura
e88bbb156b Fix redirection error
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-06-01 14:36:27 +09:00
Hiroshi Miura
74a3459773 Improve error message
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-06-01 14:31:39 +09:00
Hiroshi Miura
b34a8099e6 Add mirror url option
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-29 22:20:01 +09:00
Hiroshi Miura
39297ee72b Fix file not found error on win32_mingw73
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-29 07:43:12 +09:00
Hiroshi Miura
c5dfec81a2 Fix file not found error on win64_mingw73
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-29 07:40:01 +09:00
Hiroshi Miura
13d51e2859 Fix output path option
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-29 07:20:50 +09:00
Hiroshi Miura
5fa5b044b5 Support outputdir option
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-28 09:23:31 +09:00
Hiroshi Miura
30836c5c9f Refactoring metalink
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-26 21:48:32 +09:00
Hiroshi Miura
2d4379058b wip
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-26 21:08:31 +09:00
Hiroshi Miura
52a63e7e8d wip
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-26 16:05:49 +09:00
Hiroshi Miura
7fc67a81d5 Update proxy class for requests
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-26 13:55:38 +09:00
Hiroshi Miura
a6bfe5530a Introduce qtrequests proxy class for requests
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-05-26 13:37:23 +09:00
Hiroshi Miura
4f830a92bb Add error handler for http connection
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-03-15 08:29:12 +09:00
Hiroshi Miura
f6e704864a Utilize requests package for http access
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-03-15 07:23:12 +09:00
Hiroshi Miura
38888f544c use 7zr light weight version
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-03-10 10:14:36 +09:00
Hiroshi Miura
3333064fb6 flake8: fix F401 error
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-03-07 09:34:52 +09:00
Hiroshi Miura
b285685136 refactoring urllib usage
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-03-07 00:29:36 +09:00
Hiroshi Miura
ed0fb78ce2 Support Python2
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-03-07 00:13:03 +09:00
Hiroshi Miura
d9a9fa4ec1 fix flake8
Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-03-06 21:59:43 +09:00
Hiroshi Miura
2eecd94496 Renovation
- rename package
- rename command utility
- use six for compatibility

Signed-off-by: Hiroshi Miura <miurahr@linux.com>
2019-03-06 21:34:18 +09:00