aboutsummaryrefslogtreecommitdiffstats
path: root/packages/pipeline
Commit message (Collapse)AuthorAgeFilesLines
* pull OHLCV records from Crypto Compare (#1349)Xianny2018-12-0512-16/+491
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [WIP] pull OHLCV records from Crypto Compare * lint * refactor to pull logic out of script and into modules * add entity test for ohlcv_external entity * implement rate limit and chronological backfill for ohlcv * add unit tests; cleanup variable names * Fetch OHLCV pairs params from events table * better method names * fix outdated test * lint * Clean up after review * oops * fix failing test * better filtering of most recent records * fix bug when generating pairs * fix default earliest backfill date * fix bug with retrieving backfill time * prettier
* Token_orderbook_snapshots for Ddex and Paradex(#1354)zkao2018-12-0514-0/+669
| | | | | | * Implements the TokenOrderbookSnapshot Table * Scripts, Data Sources and Entities to pull Ddex and Paradex API data.
* Add script for parsing competing dex trades from Bloxy (#1355)Alex Browne2018-12-059-4/+498
|
* Introduce framework for running basic tests for entities (#1344)Alex Browne2018-12-0525-52/+698
| | | | | | | | | | | | | | | | | | | | | | * Introduce framework for running basic tests for entities * Add pipeline tests to CircleCI config * Make pipeline tests more configurable and fix CircleCI config * Add coverage dir to pipeline package * Add basic tests for all exchange event entities * Add tests for remaining entities * Create separate test scripts in package.json and add new info to README * Update db_setup.ts to revert migrations even if you are using docker * Automatically pull the postgres image if needed * Add comment about why NumberToBigIntTransformer is needed
* [pipeline] Add additional documentation to the README (#1328)Alex Browne2018-12-051-0/+113
|
* Reduce number of blocks per query in pull_missing_eventsAlex Browne2018-12-051-1/+1
|
* updating comment for 0x trusted tokensJake Ellowitz2018-12-054-13/+8
|
* metadata and trusted sources in same raw tableJake Ellowitz2018-12-0510-55/+75
|
* Pull token metadata re trusted tokensJake Ellowitz2018-12-0512-2/+208
|
* Add script for pulling missing block dataAlex Browne2018-12-054-4/+91
|
* Check for special characters in table name in pull_missing_eventsAlex Browne2018-12-051-3/+7
|
* Add support for pulling Cancel and CancelUpTo eventsAlex Browne2018-12-056-90/+170
|
* Add transactionHash to CancelUpToEvent and CancelEvent entitiesAlex Browne2018-12-053-1/+6
|
* Optimize database operations in pull_missing_events scriptAlex Browne2018-12-051-9/+26
|
* Add homepage_url to relayersAlex Browne2018-12-053-7/+22
|
* Add workaround for broken save methodAlex Browne2018-12-052-2/+22
|
* Fix chunk size in pull_missing_eventsAlex Browne2018-12-051-1/+1
|
* Use built-in chunk feature of TypeORM save methodAlex Browne2018-12-051-7/+2
|
* Change some column types from varchar to numericAlex Browne2018-12-0511-46/+121
|
* Add raw schema prefix to query in pull_missing_eventsAlex Browne2018-12-051-1/+1
|
* Rename taker and maker amounts in sra_ordersAlex Browne2018-12-052-2/+15
|
* Implement scraping sra orders from radar relayAlex Browne2018-12-057-24/+52
|
* Preliminary work for adding RR order book scrapingAlex Browne2018-12-051-0/+52
|
* Update schema for sra_ordersAlex Browne2018-12-052-6/+49
|
* Pointing entities to raw schemaJake Ellowitz2018-12-0510-132/+129
| | | | Fix linter issues
* Mapping dev schema to initial migrationJake Ellowitz2018-12-054-1/+208
|
* Configure linter with --format stylish and fix linter errorsAlex Browne2018-12-0512-7/+81
|
* Configure TypeORM for migrations. Add new package.json scripts.Alex Browne2018-12-056-30/+21
|
* Rename Transaction.ts to transaction.tsAlex Browne2018-12-053-0/+0
| | | | | | Rename Relayer.ts to relayer.ts Rename Block.ts to block.ts
* Add better error handling for immediately invoked async functionsAlex Browne2018-12-054-85/+20
|
* Rename table and column namesAlex Browne2018-12-0510-98/+172
|
* Reorganize entities. Make scripts work from any directory.Alex Browne2018-12-0515-14/+38
|
* Split index.ts into multiple scripts in scripts/ and detect last known block ↵Alex Browne2018-12-054-92/+95
| | | | when pulling events
* Remove unused function parameter in index.ts scriptAlex Browne2018-12-051-2/+2
|
* Use bigint for gasUsed and gasPrice in TransactionAlex Browne2018-12-052-5/+7
|
* Update relayer code to use new relayer-registry formatAlex Browne2018-12-054-6/+14
|
* Remove outdated info from READMEAlex Browne2018-12-051-21/+0
|
* Add build:ci to pipeline package.jsonAlex Browne2018-12-051-0/+1
|
* Implement fetching and parsing relayer infoAlex Browne2018-12-055-6/+107
|
* Implement support for getting and parsing blocks and transactionsAlex Browne2018-12-055-0/+149
|
* chore: Fix tslint config.Alex Browne2018-12-052-2/+2
|
* Fix bugs in merge_v2_events script and disable verbose loggingAlex Browne2018-12-052-2/+5
|
* Enable verbose loggingAlex Browne2018-12-051-1/+1
|
* Rename index.ts -> merge_v2_eventsAlex Browne2018-12-051-0/+0
|
* Update script to work with existing v1 pipeline dataAlex Browne2018-12-0510-40/+90
|
* Update pipeline to use new @0x npm org for importsAlex Browne2018-12-057-16/+16
|
* Update to use ContractWrappers + Infura instead of EtherscanAlex Browne2018-12-0510-242/+85
|
* Rebase and update to use new modularized artifactsAlex Browne2018-12-056-2289/+8
|
* Add tests for SRA order conversionAlex Browne2018-12-053-4/+83
|
* Re-add missing testsAlex Browne2018-12-053-90/+164
|
* Add soruceUrl to SraOrder entityAlex Browne2018-12-052-1/+4
|
* Add preliminary support for scraping orders from SRA endpoints (no ↵Alex Browne2018-12-058-12/+134
| | | | pagination, only RR support for now)
* For event entities, rename address -> contractAddress and make it a primary keyAlex Browne2018-12-055-11/+19
|
* Implement scraping and parsing exchange CancelUpTo eventsAlex Browne2018-12-053-9/+45
|
* Use multi-primary keys for event and filter null logIndexesAlex Browne2018-12-054-6/+15
|
* Implement scraping and parsing exchange cancel eventsAlex Browne2018-12-055-10/+81
|
* Make event parsing more functional and less class-basedAlex Browne2018-12-053-65/+21
|
* Re-organize event parsing and decodingAlex Browne2018-12-057-175/+206
|
* Add support for decoding asset dataAlex Browne2018-12-055-36/+94
|
* Add typeorm and begin inserting database recordsAlex Browne2018-12-056-13/+89
|
* Make contractAbi a parameter of getContractEventsAsyncAlex Browne2018-12-054-11/+29
|
* Add tests for etherscan eventsAlex Browne2018-12-055-10/+124
|
* Restructure pipeline package. Create data-sources dirAlex Browne2018-12-054-75/+96
|
* Remove old code. Create function for getting contract events via etherscanAlex Browne2018-12-0524-1895/+2368
|
* Rebase pipeline branch off developmentAlex Browne2018-12-0525-0/+2001
generated by cgit (git 2.34.1) at 2024-11-20 13:13:48 +0800