Commit Graph

102 Commits

Author SHA1 Message Date
scott
19723c0ea5 fixed oauth renewal errors. added functionality for retrieving list of mens and womens cats separately 2022-01-12 22:25:40 -07:00
scott
6a3c10fdef added oauth token renewal for shopping api 2022-01-11 16:27:57 -07:00
scott
3ee619ae3c allow dict_pics to write dict_pics.txt 2022-01-09 19:30:23 -07:00
scott
a4f93af3ee dict_pics cleanup and changed tag file extensions to lowercase 2022-01-09 19:16:56 -07:00
scott
8c41fe1daf new dl_pic, dict_pics methods and updated dl_pictures. fixed bugs 2022-01-07 18:28:37 -07:00
scott
ae25ab88b6 dl_pictures and curate.py cleanup 2022-01-07 02:47:22 -07:00
scott
e879e80910 blah 2022-01-04 20:53:34 -07:00
scott
fc793f4456 get_item_fromfindItemsByCateogry fix. Invalid token errors persist 2022-01-04 20:50:42 -07:00
scott
7d8be32ba8 commit before checkout 428e0379ef for ref 2022-01-03 13:32:42 -07:00
scott
525f46cc34 commit before checkout 428e0379ef for refs 2022-01-03 13:31:19 -07:00
scott
6650468756 replaced FindingApi for easy refining of cat search 2021-12-31 15:30:06 -07:00
scott
5ec46ae0c7 commit before replacing FindingApi 2021-12-31 15:08:48 -07:00
spbeach46
b349d2f07a added separate dict_pics function for changing target training images url on the fly 2021-12-17 22:26:55 -07:00
scott
2f3df22c4a added image_faults.py 2 remove faulty images, fixed non-expand PictureURL dfs 2021-12-12 19:22:09 -07:00
scott
e766a1ba9d updating update_cats for oauth 2021-12-07 13:46:24 -07:00
scott
29800af1d4 unique ids fix 2021-12-01 13:43:14 -07:00
scott
93297f952e change master 2021-11-30 18:32:01 -07:00
scott
97ab3c7dab saves list of 20_itemids instead of list of ids 2021-11-30 12:43:37 -07:00
scott
61e6770812 Removed unused FindingApi class/methods 2021-11-30 12:32:34 -07:00
scott
b6796a789e get_item_from_findItemsByCategory returns None if call limit is reach. conky will save and exit 2021-11-28 01:19:59 -07:00
scott
5a6963b371 ip limit fix 2021-11-28 00:17:34 -07:00
scott
eaf3480341 added random sleeps before making shopping api call 2021-11-26 22:38:01 -07:00
scott
2cf8270707 get_item_from_findItemsByCategory connection error fix 2021-11-26 20:40:26 -07:00
scott
0f65ab0bc2 scrape_ids working. Added function to conky in ebay_api 2021-11-26 18:46:51 -07:00
spbeach46
ab064ce5cf traditional id scraper with BeautifulSoup 2021-11-25 18:31:54 -07:00
spbeach46
eb780faf40 modTimeFrom w dateutil datetime timedelta parser integration 2021-11-21 16:05:20 -07:00
spbeach46
7cee062b78 threaded cat loop page attempt 2 with modTimeFrom 2021-11-21 12:47:04 -07:00
scott
1faa4e86fd duplicate id fixes. full data not getting fetched 2021-11-15 21:01:02 -07:00
scott
6bdc94c8c6 fixing call limit errors and duplicate ids 2021-11-10 18:01:09 -07:00
scott
428e0379ef comm before finding edit 2021-11-10 15:37:26 -07:00
spbeach46
225cf91f7b commit before merge master 2021-06-10 12:28:41 -07:00
spbeach46
2c5b878977 commit before push 2021-06-10 01:53:36 -07:00
spbeach46
fc7449827c added option to expand pics or not. Meaning @ dl only primary pic will dl 2021-06-02 00:29:58 -07:00
spbeach46
f72bfe38cb added HideDuplicate and sortOrder params to Findin class/ finding api call 2021-06-01 23:12:55 -07:00
spbeach46
5582cd29ef working 2021-06-01 22:28:54 -07:00
spbeach46
9fc00f4eab dropped na values @ training df. Used reindex instead of loc to select columns 2021-05-30 15:51:05 -07:00
spbeach46
c2a812f7a8 added used items query as default paramter in get_data() method 2021-05-27 22:00:27 -07:00
spbeach46
152b72f5df added dict for service and page input options 2021-05-25 18:47:23 -07:00
spbeach46
35cdf8374f adding csv file save and appending functionality where needed 2021-05-11 11:11:59 -07:00
spbeach46
c8ab1b13d9 Added method to update category IDs var and txt file 2021-05-10 15:14:57 -07:00
spbeach46
6cfa798902 Fixing more bugs in dl_pictures 2021-04-27 22:42:55 -07:00
spbeach46
545bc78421 fixed rest of dl_pictures bugs. Needs a little more testing 2021-04-24 15:23:47 -07:00
spbeach46
6ccce53b10 fixed some file handling bugs with dict_pics.txt 2021-04-21 17:12:35 -07:00
spbeach46
2f99c63165 fixed more dl_pictures bugs 2021-04-20 21:09:35 -07:00
spbeach46
5532a82d8d debugging dl_pictures 2021-04-15 18:26:42 -07:00
spbeach46
34a6451400 mostly finished dl_pictures(). Need testing 2021-04-13 10:10:24 -07:00
spbeach46
fb327a9375 changing custom dict to dl_pictures function and making temp_dict_pics.txt file with target_dirs.txt 2021-04-09 22:37:14 -07:00
spbeach46
ef237b8a1b added dict_pics.txt updating for expanded_dfs method 2021-04-07 15:50:23 -07:00
spbeach46
622b824eaf fixed dict_pics errors. made more robust regex pattern 2021-04-05 14:38:07 -07:00
spbeach46
fcbe4e088c added dict_pics output to curate.py and set destination var in ebay_api.py 2021-04-04 14:45:56 -07:00