Commit Graph

80 Commits

Author SHA1 Message Date
spbeach46
97c5900a5b added multithreading to both finding and shopping apis including conky() def 2020-11-12 13:22:51 -07:00
spbeach46
1134d3f155 adding multithreading to first call in main 2020-11-08 18:47:03 -07:00
spbeach46
5965f19d2a adding functions to curateData class 2020-11-07 10:39:49 -07:00
spbeach46
cd21c98e54 removed Unbound assignment error for accessing training.csv during exception handling. working on runtimeerror for mutable dictionary in curate_data loop 2020-11-05 15:32:41 -07:00
spbeach46
904014ea38 added conditional to check if item id in both item_id_results_list and in local file to eliminate variations listings including written data 2020-10-30 21:55:40 -07:00
spbeach46
47b77600a5 corrected update_df to iterate over items and nvl kv pairs. and began check for repeat results 2020-10-24 03:36:31 -07:00
spbeach46
b64e2f74c1 had to convert inputs to ints and correct filenotfounderror in get_ids_from_cats fuction 2020-10-18 15:32:17 -07:00
spbeach46
26b425f31c Changed to_csv mode to append to allow for writing if not present and appending if present 2020-10-18 13:56:16 -07:00
spbeach46
60b8f8979c changed big_data names to training 2020-10-18 00:08:04 -07:00
spbeach46
7c338e69d5 added error handling for initial/empty csv file 2020-10-17 17:22:45 -07:00
spbeach46
ae5a4e92bb added CurateData class for preprocessing pipeline fucntionality 2020-10-17 16:21:11 -07:00
spbeach46
58d8c8cda7 added get_data method call to get_ids_from_cats call 2020-10-12 18:42:57 -07:00
spbeach46
68f1341012 added get_data method for easier debugging. Added zeroth index term to ...['itemId'] 2020-10-12 17:55:07 -07:00
spbeach46
12f4770eaf corrected pageNumber and service params. Need to fix typeError on line 24-27 2020-10-12 11:48:15 -07:00
spbeach46
acb5955b97 comment before adding pagenumber and service to init 2020-10-12 00:53:29 -07:00
spbeach46
aa73991c3c fixed classes, variables, methods to not show any terrible errors 2020-10-11 23:11:59 -07:00
spbeach46
47ad8639ff changing defs to methods and variables to attributes. Trial and error. Code seems to be broken right now 2020-10-11 22:12:01 -07:00
spbeach46
9d02381140 completed conditional to check for itemId existence in csv data and 20-itemId string list generator 2020-10-08 03:07:41 -07:00
spbeach46
873050f898 removed list(map(str,item_id_results)) because itemIds are already strings 2020-10-08 00:20:01 -07:00
spbeach46
3b0b96fd92 around line 37, creating itemId list to pipe into shopping api call/class 2020-10-07 18:53:19 -07:00
spbeach46
b5afa5cfc0 removed deleted stuff? 2020-10-04 23:48:52 -07:00
spbeach46
77038e92f8 deleted shopping_test.py and saved as shopping_api.py. Added classes including from finding_api.py 2020-10-04 23:39:13 -07:00
spbeach46
752fa7efaa removed some linting errors and figured out how to add dicts to pandas df (see shopping_test.py comments 2020-10-04 00:48:55 -07:00
spbeach46
116dcfcdd6 done w/complete single item dataframe conversion using json and pandas 2020-10-03 22:19:01 -07:00
spbeach46
21804923a5 constructing dataframe from json semi-manually 2020-09-30 23:50:36 -07:00
spbeach46
643e475dec deleted some more useless comments 2020-09-29 20:08:37 -07:00
spbeach46
ed4b39b386 deleted some useless stuff 2020-09-29 20:06:34 -07:00
spbeach46
d675c05a42 added notes about data collection plan 2020-08-24 11:25:22 -07:00
spbeach46
b9f06c0dfe added modular operation name 2020-08-23 20:17:24 -07:00
spbeach46
0197646596 first commit 2020-08-23 06:08:15 -07:00