5106 Commits
Author SHA1 Message Date
paulhainsworth-chiaandGitHub b74a3f3849 changelog1.2.11 (#9137)
* changelog1.2.11
1.2.11
2021-11-04 17:17:00 -07:00
YostraandGitHub 39c9bc1a41 change constant (#9130) 2021-11-04 15:29:43 -07:00
Adam KellyandGitHub 869f39893c Plotnft fees cmdline fix (#9129)
* Add fees to plotnft commandline and RPCs

* Return calculated fee based on number of transactions

* Extend tests to support fees. Default fee to 0 if not present in RPC call.

* Make plotnft cmdline fees use XCH, like

* fix validator

* cmdline tests

* Remove duplicate option
2021-11-04 15:29:11 -07:00
Chris MarslenderandGitHub 284d05b364 Add cleanup action to m1 to make sure we start wiht a fresh WD (#9126) 2021-11-04 15:38:55 -05:00
Chris MarslenderandGitHub f93787d942 ARM64 installer updates (#9120)
* Refactor the whole workflow to run in a container rather than just one step

* Update to chianetwork/ubuntu-18.04-builder:latest image

* Remove some steps that install things that are now pre-baked to the container

* Remove caches for now

* Update path to github workspace

* Add clean workspace action

* Fix linux installer artifact path
2021-11-04 15:19:06 -05:00
Adam KellyandGitHub 996f518810 Plotnft fees (#9116)
* Add fees to plotnft commandline and RPCs

* Return calculated fee based on number of transactions

* Extend tests to support fees. Default fee to 0 if not present in RPC call.
2021-11-04 10:44:36 -07:00
8a028c3594 Ms.mempool locking (#9050)
* Prority locking to consensus

* Remove pstats

* Linting

* Do some stuff outside of lock

* Fix startup

* Add log timings

* Try some different locking

* Add limit

* catch excp

* CLVM inside lock

* Try using a semaphore instead

* use events for lock queue

* test

* Add logging for message types

* type

* remove seed

* check new peak waiters

* correct FullNodeAPI self.full_node.new_peak._waiters typo

* correct logging string typos

* only warn about new_peak Waiters if there is at least 1

* remove no-longer-accepted parameter to FullNode.peak_post_processing()

* only warn about respond_transaction Waiters if there is at least 1

* lint

* Change some constants

* Small fix and logging changes

* Put message types outside

* Change some log levels so we can test with info

* More logging

* Increase rate limits but decrease paralelism

* tweaks

* Log dropped tx

* Fix pool rpc test

* Test fixes

* Mempool optimization

* Remove from seen if fails

* Increase queue sizes

* Message types info

* More test and logging

* Small changes to networking just in case

* Decrease logging

* Decrease logging even further

* Decrease logging even further even further

* Decrease logging 3

* Transaction queue

* Don't cancel tasks or close connection

* Cancel tasks on disconnect (for shutdown purposed)

* Fix typo

* Catch cancelled

* Do multiple at a time

* More accurate farmer response time

* More efficiently create tasks

* Increase queue size and priority by fee

* Revert priority

* Don't re-request too many times for dropped TX

* Handle cancelled error so we don't go into a bad state

* Catch cancelled in syncing tasks

* Reduce new_peak_sem to improve performance

* Less bytes conversion

* Missing file, and 2 workers for CLVM

* Validate BLS in a new thread

* tests

* Change semaphore constants

* correct a cancellation triggered exception and assertion

* Fix send_transaction, dont use BaseException, fix tests

* Fix more tests

* only log transaction handler cancellation in debug

* typing in log

* move unfinished validation to diff proc

* it is asyncio.CancelledError

* Add a test for bad signature

* Fix more tests, reduce logging, lint

* One more lint

* blockchain tests, pass bytes directly, single call

* Try to fix rl_wallet failures

* Fix mempool test

* catch everything

* Don't test RL wallet

* Fix more tests and return error code

* Improve error handling in multiprocess

* Add pre-validation time

* Add pre-validation time in logs, and revert pytest.ini changes

* Add log correctly

* Ms.bls cache experiment (#9115)

* Logging for cache

* Less logging

* Return to original plan

* Clean up

* Remove coment

* Remove log

* formalize LockQueue shutdown

* Comments

* Fix blockchain test

* Improve cache

* Remove logs

* Fix sign_coin_spends

* Fix pool wallet

Co-authored-by: Kyle Altendorf <sda@fstab.net>
Co-authored-by: Yostra <straya@chia.net>
2021-11-04 09:29:05 -07:00
JeffandGitHub c80208cda9 Terminate madmax/bladebit on Windows on Ctrl-C (#9113) 2021-11-04 08:59:13 -07:00
wjblankeandGitHub c1796c3b63 switch to forked dnspython v2.2.0 (#9107) 2021-11-03 16:45:16 -07:00
wjblankeandGitHub 1c201c49d5 510 (#9109)
5.1.0 multidict
2021-11-03 16:44:29 -07:00
Kyle AltendorfandGitHub eb62a28519 Add missing .name() in WalletStateManager.get_filter_additions_removals() (#8958) 2021-11-02 08:44:43 -07:00
justinenglandandJustin England 479f89c9b0 friendlier class calls 2021-11-01 22:39:26 -06:00
justinenglandandJustin England acea2fccb4 black 2021-11-01 22:39:26 -06:00
justinenglandandJustin England 7aee94c82b removing is not none 2021-11-01 22:39:26 -06:00
justinenglandandJustin England a7581a4692 adding any variable device 2021-11-01 22:39:26 -06:00
justinenglandandJustin England 99cbdedc1c using None again 2021-11-01 22:39:26 -06:00
justinenglandandJustin England f79f07ab98 changing bool to string 2021-11-01 22:39:26 -06:00
justinenglandandJustin England 02ece9c549 replacing none with quotes 2021-11-01 22:39:26 -06:00
justinenglandandJustin England 2c54becd02 fixing bad include 2021-11-01 22:39:26 -06:00
justinenglandandJustin England 1e3985c56f syntax 2021-11-01 22:39:26 -06:00
justinenglandandJustin England d6ff52cc0b syntax 2021-11-01 22:39:26 -06:00
justinenglandandJustin England c32721d28c syntax 2021-11-01 22:39:26 -06:00
justinenglandandJustin England 552b4a1860 more formatting 2021-11-01 22:39:26 -06:00
justinenglandandJustin England 39ea9847a0 fixing flake8 2021-11-01 22:39:26 -06:00
justinenglandandJustin England 25d297457e click option wording improved 2021-11-01 22:39:26 -06:00
justinenglandandJustin England f16d3bbedc adding testnet options to chia init 2021-11-01 22:39:26 -06:00
Kyle AltendorfandGitHub 3df0f9ebe4 Restore original CWD in Install-gui.ps1 (#8912)
The original script left the user in the `chia-blockchain-gui/` directory and despite the instructions to `cd chia-blockchain-gui`.
2021-10-29 10:45:13 -07:00
Kyle AltendorfandGitHub b4ab2bd0c7 Avoid activating venv in Install.ps1 (#8927)
PowerShell scripts, as well as batch files, operate in the callers environment which is unlike bash where you have to `source` (or `.`) scripts for that to happen.  As such, this script returned control to the user with the venv still activated which was somewhat counter to the instructions that were printed out.  I suggest this route of leaving the environment not activated on exit for the sake of consistency with `install.sh`.  I chose to simply not activate the venv to begin with since then there's no deactivation "cleanup" to manage.
2021-10-29 10:44:46 -07:00
Kyle AltendorfandGitHub 983c6e3dd9 Add hexstr_to_bytes() in WalletRpcApi.get_trade() (#8968)
* Add hexstr_to_bytes() in WalletRpcApi.get_trade()

* .hex() to print some bytes32
2021-10-29 10:41:39 -07:00
Kyle AltendorfandGitHub 4a12db54a5 Make WalletPuzzleStore.get_derivation_record_for_puzzle_hash() take bytes32 (#8960) 2021-10-29 10:39:06 -07:00
Kyle AltendorfandGitHub 027aa116a2 Remove tupling of a hash (#8948) 2021-10-29 10:27:39 -07:00
dustinfaceandGitHub d9143063ff plotting: Reduce Path.exists calls (#8999)
* plotting: Move plot removals out of `PlotManager.refresh_batch`

Moving this checks up in the trace so that it only runs once for each
refresh cycle reduces `plot_removed` calls per cycle from `batch_count *
plot_count` to `plot_count` only. This checks can be quite expensive
depending on how/where the plots are stored so this should noticeably
improve refresh times in slow setups and large farms even for the
initial refresh cycle. I don't see any downside here considered that
even if a plot gets removed during a refresh cycle (after the checks
run) it will catch it in the next cycle.

**Note**: This has become an issue now (e.g. in #8972) because prior to
way, that it only really processed in batches for the very first run
after a restart. For each repeated refresh cycle it just walked through
all files in one `refresh_batch` call. Now after #8385 fixed this
behavior the checks are called `batch_count * plot_count` for all
refresh cycles, even for each repeated cycle where it was `plot_count`
before.

* plotting: Move `file_path.exists` call down 

There is no point in testing it before here, it only leads to redundant 
calls for repeated refresh cycles. The important point here is just that 
it runs after 

```
if file_path in self.plots:
    return self.plots[file_path]
```

so it could still be moved around differently if there are other 
suggestions, tell me. I even think it might be possible to just drop it 
with no bad impact but lets just move it for now.
2021-10-29 09:29:46 -07:00
Matt HauffandGitHub 3d1aa2b01d Check that launcher is interesting (#9003)
* Check that launcher is interesting

* Added test

* Lint
2021-10-29 08:43:02 -07:00
JeffandGitHub 13ac86c819 Fix detection of madmax completion (#9016)
* Fix madmax completion detection when tempdir == finaldir

* Detect madmax completion cases (temp==final, temp & final on same volume, temp & final on different volumes)
2021-10-29 08:40:05 -07:00
William Blanke d1d72d77d7 updated gui to 1863a31603db272746af4db2b4003280c51d302b 2021-10-28 15:42:25 -07:00
f550555c7d Add plotters. (#8497)
* Initial commit add plotters.

* Lint.

* Add progress for bladebit.

* Address some review comments.

* Oops...

* Add install option.

* Change chiapos to fit the old standard.

* Update chia/plotters/bladebit.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Update chia/plotters/install_plotter.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Lint.

* Remove farmerkey as required.

* Chia plotters chiapos works with no arguments.

* Added get_plotters RPC to support the GUI (#8530)

* Added 'get_plotters' daemon RPC. Probes installed/available plotters on behalf of the GUI.

* Linter fix

* Minor type tweak

* Tweaks.

* Run with default arguments all plotters.

* Fix bug.

* Update chia/plotters/bladebit.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Change bladebit repo.

* Update chia/plotters/bladebit.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Update chia/plotters/plotters.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Update chia/plotters/plotters.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Update chia/plotters/plotters.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Update chia/plotters/plotters.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Update chia/plotters/plotters.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Update chia/plotters/plotters.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Update chia/plotters/plotters.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Update chia/plotters/plotters.py

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>

* Re-added the connect-to-daemon hidden option

* Use connect_to_daemon value for madmax and bladebit plot key resolution.

* Updated --tmp_dir, --tmp_dir2, --final_dir options to match old options from chia plots create

* Add CONNECT_TO_DAEMON as a valid option for madmax/bladebit

* Thread multiplier should be an int

* Passing params for madmax to start_plotting. Still needs cleanup/refactoring.

* Update chia/plotters/bladebit.py

Co-authored-by: Kyle Altendorf <sda@fstab.net>

* Update chia/plotters/madmax.py

Co-authored-by: Kyle Altendorf <sda@fstab.net>

* Filename option -z.

* Factor out calling the plotter.

* First attempt refactor install scripts.

* Switch to exec.

* Attempt to fix mypy warning.

* Remove filename.

* Increase RLIMIT_NOFILE for madmax on non-Windows platforms

* Add trailing path separator to madmax tmpdir/tmp2dir/finaldir arguments (required by madmax)

* Fixes to support madmax plotting from the GUI.
Writing output from the plotters now includes a flush to ensure the plotter log (used by the GUI) is updated frequently.

* Handle madmax's tmptoggle option internally when plotting with the GUI

* Formatting and linter fix

* Fixed the -i option for bladebit

* Construct BladeBit plotting options

* Cleanup code for building plotter command line options

* Added a post-processing step after each plotting job completes. Adds the final_dir plot directory as necessary.

* Fix plotter root path

* Reverting prior checkin. Need to figure out how to handle CHIA_ROOT being overridden

* BladeBit support for Windows

* BladeBit's --memory-json option is used to check memory requirements

* Madmax Windows support

* Plotters directory is now under CHIA_ROOT

* Madmax version detection

* BladeBit will default to 0 threads. BladeBit will max-out available threads with this configuration.

* LGTM fixes

* Module definition for chia.plotters to resolve mypy issues with chiapos (package vs chiapos.py)

* Updated BladeBit build script to account for 1.2.0 changes.
Replaced remaining subprocess.run calls with run_command.
Use BladeBit's reported memory requirement instead of hardcoded value.

* Show a disclaimer when using thirdparty plotter

* Test adding mac madmax plotter to the installers

* Get latest madmax from the latest GH release

* Fix bad var name

* m1 madmax

* Add linux/linux arm

* pip install -e for arm installer, so that its consistent with the other platforms when looking for additional files

* madmax + windows

* Get madmax with Invoke-WebRequest

* Use the correct windows slashes

* add madmax to the list of windows binaries

* Check if madmax exists on windows install and move it to site packages if it does

* Make sure windows has .exe extension for madmax

* Update azure to get latest version of madmax from GH releases

* Bladebit for linux/linux arm

* Fix error with binaries.extend

* Bundle bladebit + windows

* Fix download url for bladebit

* Check for bladebit in windows script. move to correct directory if it exists

* Detect and use packaged plotters

* Removed unnecessary import

* Updating the branch to use chiaplotters_gui for installer verification

* Removed a change that was intended for debugging only

* Remove disclaimer

* Updated for new madmax plotter with k33, k34 support.
Updated chia-blockchain-gui submodule

* Fixed typo

* Package the chia_plot_k34 executable

* Boink

* Revert "Boink"

This reverts commit 8d13c07110.

* Additional chia_plot_k34 spots that I missed

* pyinstaller.spec fix for chia_plot_k34

* Windows installer fix for chia_plot_k34.exe

* Restoring chia-blockchain-gui submodule to 047ce16 (as in main)

* Update to chiapos 1.0.6

Co-authored-by: Jeff Cruikshank <paninaro@gmail.com>
Co-authored-by: Jeff Cruikshank <jeff@chia.net>
Co-authored-by: Kyle Altendorf <sda@fstab.net>
Co-authored-by: Chris Marslender <chrismarslender@gmail.com>
Co-authored-by: Earle Lowe <30607889+emlowe@users.noreply.github.com>
2021-10-28 15:37:46 -07:00
William Blanke 6205d954e8 unreleased 2021-10-27 16:41:02 -07:00
William Blanke 296a19bce4 1.2.11 2021-10-27 16:13:32 -07:00
William Blanke 2d7a59655d update clvm_rs to 0.1.15 2021-10-27 11:42:28 -07:00
Mariano SorgenteandGitHub 55406d729b Rate limits for new protocol (#8977) 2021-10-27 08:35:41 -07:00
Jeff CruikshankandGitHub 52ae2bc8f0 Fix packaging failure with relative import when using --passphrase-file (#8973)
* Change the .passphrase_funcs import to see if pyinstaller packages it properly

* Try out a fully-qualified import scoped at the if block
2021-10-26 17:11:10 -07:00
Matt HauffandGitHub 0e941f5144 Fix launcher name definition (#8971)
* Fix launcher name definition

* Minor update per @yostra
2021-10-26 16:17:33 -07:00
William Blanke 0952c29681 updated gui to 047ce16c8d71fcd10a6304ff984d4bd8fb84faed 2021-10-26 16:07:20 -07:00
Jeff CruikshankandGitHub f7f44d15ab Fix long load times when selecting the default wallet key from the GUI. (#8938)
When creating a new WalletNode at launch, the fingerprint will be set to None. After a lengthy initialization task, the logged-in fingerprint was set to None instead of the default private key's fingerprint. If the user then selected that same key in the key selection screen, the same lengthy initialization task would be repeated. This fix will set the logged-in fingerprint to the default key's fingerprint if the fingerprint wasn't originally specified.
2021-10-26 15:31:49 -07:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
ec8d3ae2f9 Bump watchdog from 2.1.3 to 2.1.6 (#8732)
Bumps [watchdog](https://github.com/gorakhargosh/watchdog) from 2.1.3 to 2.1.6.
- [Release notes](https://github.com/gorakhargosh/watchdog/releases)
- [Changelog](https://github.com/gorakhargosh/watchdog/blob/master/changelog.rst)
- [Commits](https://github.com/gorakhargosh/watchdog/compare/v2.1.3...v2.1.6)

---
updated-dependencies:
- dependency-name: watchdog
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-26 00:34:52 -07:00
Gene HoffmanandGitHub 010585678a Fix test formatting (#8945)
* Fix test formatting

* Trim trailing whitespace
2021-10-25 23:27:12 -07:00
paulhainsworth-chiaandGitHub 00382222d9 changelog 1.2.10 (#8941)
* changelog 1.2.10
1.2.10
2021-10-25 17:34:01 -07:00
William Blanke c9f981c437 update gui to 14eac4407cb610c984c27c04cf7f8c5fbf591f30 2021-10-25 11:45:21 -07:00
YostraandGitHub 1bbc987171 Fix iteration (#8934)
* iterate values

* add test
2021-10-25 11:39:45 -07:00
Arvid NorbergandGitHub 897b7a4f41 catch BaseException (#8933) 2021-10-25 11:23:14 -07:00