Commit Graph
14659 Commits
Author SHA1 Message Date
Kyle Altendorf 2a2bd63f3f update docstrings 2021-12-01 20:15:18 -05:00
Kyle Altendorf 734903181f wait for transaction records to actually be in the coin store 2021-12-01 19:51:32 -05:00
Kyle Altendorf 9b0c6ae92d drop timeouts 2021-12-01 18:49:03 -05:00
Florin ChiricaandGitHub ae8bdbc3c7 Windows blueboxing. (#8394)
* Windows bluebox.
2021-12-01 11:32:49 -08:00
Arvid NorbergandGitHub a75b639adf fix typo in block_store benchmark (and missing clvm generator field) (#9433) 2021-12-01 11:31:31 -08:00
Arvid NorbergandGitHub a9d0346fd0 cache heigh-to-hash and height-to-ses maps between runs (#8771)
* factor out map of block height to block hash and sub epoch summary from blockchain into its own class, BlockHeightMap

* save and restore the height-to-hash map and height-to-sub epoch summary map to flat files, to imrove startup time. Add unit tests

* add back assert
2021-12-01 09:43:16 -08:00
Arvid NorbergandGitHub e10c58f66c Spent field (#9386)
* ensure that the spent field is redundant. It can be deduced from (spent_index == 0)

* use spent_index instead of spent, in coin_record database

* since we don't use the spent-field, there's no need to query the database for it
2021-12-01 09:42:15 -08:00
Arvid NorbergandGitHub b91a0eaddc avoid calling SpendBundle.fees() a second time in peak post processing 2. This is an expensive function, that's why we cache its result (#9434) 2021-12-01 09:41:50 -08:00
Kyle Altendorf a29f85ced9 mypy 2021-12-01 09:07:54 -05:00
Kyle Altendorf cd67110487 actually wait for the wallet to receive the farmed coins 2021-12-01 01:29:14 -05:00
Kyle Altendorf 7283bc5d2c wait for transaction records, not spend bundle names 2021-11-30 19:44:39 -05:00
Arvid NorbergandGitHub fdaadc1ff9 add benchmark for block_store (#9425)
* add benchmark for block_store

* use random instead of secrets
2021-11-30 15:56:11 -08:00
Kyle Altendorf 5b3b3083d0 undisable tests 2021-11-30 18:30:25 -05:00
Kyle Altendorf 47ec412ee7 lint 2021-11-30 18:15:16 -05:00
Kyle Altendorf aa4720cfee relate the time lock with the block time 2021-11-30 18:13:50 -05:00
Kyle Altendorf d0d676e68c remove a couple more 'old-style' block progressions 2021-11-30 15:52:50 -05:00
Arvid NorbergandGitHub f030e32edf Name coin fields (#9381)
* name the fields we pull from the coin_records database

* we don't need to ask for the coin_name in coin_record lookups, we never use it
2021-11-30 06:43:54 -08:00
Kyle Altendorf 52ac5d3930 remove unneeded .is_transaction_block() check 2021-11-29 23:16:32 -05:00
Kyle Altendorf 468ef78a9b add FullNodeSimulator.wait_spend_bundle_entered_mempool() and .process_spend_bundles() 2021-11-29 23:02:44 -05:00
Kyle Altendorf 892d06aa6c remove macos-specific sleeps etc 2021-11-29 16:31:12 -05:00
Kyle Altendorf 4864c87573 wait for transactions to enter mempool 2021-11-29 16:17:39 -05:00
Arvid NorbergandGitHub 8d617f0df0 _blockchain_lock_queue is not always initialized by the time we shut down (#9402) 2021-11-29 10:58:14 -08:00
Arvid NorbergandGitHub 7f2be11da7 print database size in CoinStore benchmark (#9419) 2021-11-29 07:48:42 -08:00
Kyle Altendorf 2057d388e4 import sys 2021-11-28 15:08:10 -05:00
Kyle Altendorf edb4ea0c59 make hacks for macos only apply on macos 2021-11-28 14:54:36 -05:00
Kyle Altendorf 3dafdadd3b fixup 2021-11-28 14:32:03 -05:00
Kyle Altendorf 5ebc26d58e Revert "debug--"
This reverts commit e8462ceb53.
2021-11-28 14:28:19 -05:00
Kyle Altendorf e8462ceb53 debug-- 2021-11-28 14:14:19 -05:00
Kyle Altendorf f827d43fa1 debug 2021-11-28 14:02:22 -05:00
Kyle Altendorf 33fe9ca591 debug 2021-11-28 12:55:28 -05:00
Kyle Altendorf a724910fda debug 2021-11-28 12:41:18 -05:00
Kyle Altendorf d3af2d74e4 debug 2021-11-28 12:17:24 -05:00
Kyle Altendorf 693fee7d65 debug 2021-11-28 11:45:31 -05:00
Kyle Altendorf 42fc9b2684 wait for all to be sent from tx_store 2021-11-27 23:43:45 -05:00
Kyle Altendorf 276ac0c440 debug 2021-11-27 22:31:36 -05:00
025c45f0b5 Chia Seeder (#8991)
* initial hack

* crawler

* add pytz

* Checkpoint.

* Catch some bugs.

* Localhost dig working.

* Checkpoint: return only high quality nodes.

* Statistics.

* Try improving finding reliable nodes.

* Bug.

* Move db to memory.

* Timestamp in the last 5 days.

* Increase crawl parameters, 180+ connections per sec.

* Bug.

* Optimize for DNS traffic.

* Prepare for hosting.

* Minimum height.

* Typo.

* Try catch everything.

* dnslib.

* Add db, format code.

* nits.

* No connections for the dns server.

* Rename src -> chia

* Fix some issues with v1.1

* Crawler task pool.

* Optimize closing connections.

* Split crawler and dns server.

* Install instructions.

* Catch startup bug.

* Try a big timeout for lock aquire.

* lint.

* Lint.

* Initial commit extended stats.

* Simplify code.

* Config.

* Correct stats.

* Be more restrictive in crawling.

* Attempt to fix stats bug.

* Add other peers port to config.

* Update README for the config.

* Simplify crawl task.

* Fix bug on restarts.

* Prevent log spamming.

* More spam prevention.

* Fix bug.

* Ipv6 (#1)

* Enable ipv6.

* Fix bug.

* Use numeric codes for QTYPE.

* ANY working.

* More spam prevention.

* Try to improve IPv6 selection.

* Log IPv6 available.

* Try to crawl more aggresive for v6.

* rename dns.py to crawler_dns.py so it doesn't conflict with imported package names

* Remove pytz package off dependencies

* Tidy-up ws_connection.py

* Fix spelling

* Reinstate chia-blockchain readme, with additional lines pertaining to the DNS introducer & crawler

* More detailed info in the README wrt Chia Seeder

* Nit

* More memetic naming of Chia Seeder

* Nit

* Add entry points

* Add entry in packages

* Patch some methods on the upstream server

* Update peer record fields

* Standard library imports first

* Crawler API check

* Reconcile crawl store

* Account for crawler_db_path in config

* Await crawl store load DB and load reliable peers

* Updates to crawler

* Rename to dns_server

* Crawler-specific overrides for the chia server

* Edit comment

* Undo changes to ChiaServer in view of crawler-specific overrides introduced in previous commit

* Nit

* Update service groups

* Expand name maps, mostly

* Fix the init config

* Remove unused import

* total_records unused at this stage

* Remove ios_reliable in peer_reliability table

* Remove row[20] entry

* Split overly long line

* Fix

* Type hint for ns_records

* Reconcile mismatch btw type int and uint64

* Type annotations in crawler

* Check whether crawl store is set

* Remove upnp_list

* Lint

* Chia Seeder CLI

* Lint

* Two white spaces

* 3rd party package import

* Cleaner way to handle overrides for ChiaServer method

* Address linter warnings

* Rename

* Nits

* Fix

* Change port #

* Most chia_seeder commands up and running

* Rename

* Progress of sorts

* Fix

* Improve legibility

* Fix naming

* Fix setup.py

* Lint

* None -> ''

* Remove whitespace

* Rename

* Log ipv6 better. (#9227)

* Log ipv6 better.

* Lint.

* -

* Undo GUI changes

* Another attempt

* GUI changes

Co-authored-by: Yostra <straya@chia.net>
Co-authored-by: Florin Chirica <fchirica96@gmail.com>
Co-authored-by: Chris Marslender <chrismarslender@gmail.com>
2021-11-27 18:30:25 -08:00
GregoryandGitHub a80b7df38c [Easy] Fix typo, and display overlap if applicable (#8992)
* VAILD_* -> VALID_*

* Display overlap, using format string literals

* Fix
2021-11-27 18:29:46 -08:00
dustinfaceandGitHub 3c21db387c tests: Fix test environment creation in test_plot_manager.py (#9370)
The `bt.refresh_plots()` wasn't even awaited and the test environments 
all shared the same root. Now every environment gets its own temp 
directory where the plots relevant for the tests are copied to.
2021-11-27 18:20:08 -08:00
Kyle Altendorf c23050267c Merge branch 'atari' into atari-rework_block_farming 2021-11-27 21:14:45 -05:00
Kyle Altendorf 3108d4068e update workflows 2021-11-27 21:14:28 -05:00
Kyle Altendorf 1f040fb907 Merge branch 'atari' into atari-rework_block_farming 2021-11-27 19:43:58 -05:00
Kyle Altendorf b1abc3df26 Merge branch 'main' into atari 2021-11-27 19:43:42 -05:00
Kyle Altendorf 71ffcb9c27 remove a comment 2021-11-27 19:18:08 -05:00
Kyle Altendorf e424330e99 comments and docstrings 2021-11-27 19:04:46 -05:00
Kyle AltendorfandGitHub 81da8292fd oops 2021-11-27 17:46:56 -05:00
Kyle Altendorf 859639deaf Merge branch 'atari' into atari-rework_block_farming 2021-11-26 22:26:07 -05:00
Kyle Altendorf 4c7b79e715 close db connections in tests.core.data_layer.test_data_rpc 2021-11-26 22:25:38 -05:00
Kyle Altendorf afb61733a3 mypy 2021-11-26 21:46:58 -05:00
Kyle Altendorf 9ebe5065d3 more block progression help 2021-11-26 21:36:50 -05:00
Kyle AltendorfandGitHub bf01b58cb4 tweak mypy config (#9368)
* tweak mypy config

* add types-click to pre-commit
2021-11-24 13:06:39 -08:00