scott
|
b6796a789e
|
get_item_from_findItemsByCategory returns None if call limit is reach. conky will save and exit
|
2021-11-28 01:19:59 -07:00 |
|
scott
|
5a6963b371
|
ip limit fix
|
2021-11-28 00:17:34 -07:00 |
|
scott
|
eaf3480341
|
added random sleeps before making shopping api call
|
2021-11-26 22:38:01 -07:00 |
|
scott
|
2cf8270707
|
get_item_from_findItemsByCategory connection error fix
|
2021-11-26 20:40:26 -07:00 |
|
scott
|
0f65ab0bc2
|
scrape_ids working. Added function to conky in ebay_api
|
2021-11-26 18:46:51 -07:00 |
|
spbeach46
|
ab064ce5cf
|
traditional id scraper with BeautifulSoup
|
2021-11-25 18:31:54 -07:00 |
|
spbeach46
|
eb780faf40
|
modTimeFrom w dateutil datetime timedelta parser integration
|
2021-11-21 16:05:20 -07:00 |
|
spbeach46
|
7cee062b78
|
threaded cat loop page attempt 2 with modTimeFrom
|
2021-11-21 12:47:04 -07:00 |
|
scott
|
1faa4e86fd
|
duplicate id fixes. full data not getting fetched
|
2021-11-15 21:01:02 -07:00 |
|
scott
|
6bdc94c8c6
|
fixing call limit errors and duplicate ids
|
2021-11-10 18:01:09 -07:00 |
|
scott
|
428e0379ef
|
comm before finding edit
|
2021-11-10 15:37:26 -07:00 |
|
spbeach46
|
225cf91f7b
|
commit before merge master
|
2021-06-10 12:28:41 -07:00 |
|
spbeach46
|
2c5b878977
|
commit before push
|
2021-06-10 01:53:36 -07:00 |
|
spbeach46
|
fc7449827c
|
added option to expand pics or not. Meaning @ dl only primary pic will dl
|
2021-06-02 00:29:58 -07:00 |
|
spbeach46
|
f72bfe38cb
|
added HideDuplicate and sortOrder params to Findin class/ finding api call
|
2021-06-01 23:12:55 -07:00 |
|
spbeach46
|
5582cd29ef
|
working
|
2021-06-01 22:28:54 -07:00 |
|
spbeach46
|
9fc00f4eab
|
dropped na values @ training df. Used reindex instead of loc to select columns
|
2021-05-30 15:51:05 -07:00 |
|
spbeach46
|
c2a812f7a8
|
added used items query as default paramter in get_data() method
|
2021-05-27 22:00:27 -07:00 |
|
spbeach46
|
152b72f5df
|
added dict for service and page input options
|
2021-05-25 18:47:23 -07:00 |
|
spbeach46
|
35cdf8374f
|
adding csv file save and appending functionality where needed
|
2021-05-11 11:11:59 -07:00 |
|
spbeach46
|
c8ab1b13d9
|
Added method to update category IDs var and txt file
|
2021-05-10 15:14:57 -07:00 |
|
spbeach46
|
6cfa798902
|
Fixing more bugs in dl_pictures
|
2021-04-27 22:42:55 -07:00 |
|
spbeach46
|
545bc78421
|
fixed rest of dl_pictures bugs. Needs a little more testing
|
2021-04-24 15:23:47 -07:00 |
|
spbeach46
|
6ccce53b10
|
fixed some file handling bugs with dict_pics.txt
|
2021-04-21 17:12:35 -07:00 |
|
spbeach46
|
2f99c63165
|
fixed more dl_pictures bugs
|
2021-04-20 21:09:35 -07:00 |
|
spbeach46
|
5532a82d8d
|
debugging dl_pictures
|
2021-04-15 18:26:42 -07:00 |
|
spbeach46
|
34a6451400
|
mostly finished dl_pictures(). Need testing
|
2021-04-13 10:10:24 -07:00 |
|
spbeach46
|
fb327a9375
|
changing custom dict to dl_pictures function and making temp_dict_pics.txt file with target_dirs.txt
|
2021-04-09 22:37:14 -07:00 |
|
spbeach46
|
ef237b8a1b
|
added dict_pics.txt updating for expanded_dfs method
|
2021-04-07 15:50:23 -07:00 |
|
spbeach46
|
622b824eaf
|
fixed dict_pics errors. made more robust regex pattern
|
2021-04-05 14:38:07 -07:00 |
|
spbeach46
|
fcbe4e088c
|
added dict_pics output to curate.py and set destination var in ebay_api.py
|
2021-04-04 14:45:56 -07:00 |
|
spbeach46
|
b205b44b50
|
added function to create custom image url dictionary
|
2021-04-04 14:38:04 -07:00 |
|
spbeach46
|
35100b7952
|
fixed extract_contents for expanded_dropd df
|
2021-04-03 13:09:21 -07:00 |
|
spbeach46
|
167f1f29ec
|
added download fix
|
2021-04-02 23:42:31 -07:00 |
|
spbeach46
|
3c16301a96
|
Created curate file for running curate methods from ebay_api.py
|
2021-04-02 11:08:56 -07:00 |
|
spbeach46
|
6abf695908
|
added some exceptions but still likely incomplete
|
2021-02-14 01:34:56 -07:00 |
|
spbeach46
|
816fb797fa
|
added function to extract list values from cells
|
2021-02-08 20:16:58 -07:00 |
|
spbeach46
|
855e65af80
|
dropping cols from nvl_df and combining class_training with nvl_training
|
2021-02-07 12:25:37 -07:00 |
|
spbeach46
|
1087027812
|
corrected for setcopywarning
|
2021-01-31 22:13:52 -07:00 |
|
spbeach46
|
fc0090ea3e
|
added config file import
|
2021-01-31 21:49:24 -07:00 |
|
spbeach46
|
627992036a
|
reverted back to creds in script. change to config file method
|
2021-01-30 03:38:26 -07:00 |
|
spbeach46
|
4f46741a0f
|
added notes and changed security_appname to var
|
2021-01-30 03:08:10 -07:00 |
|
spbeach46
|
72db161858
|
created def for class training set and nvl training set. Still unfinished
|
2021-01-29 23:48:19 -07:00 |
|
spbeach46
|
18871a76d7
|
added nvl_dict function to create series based on nvl dict of raw data
|
2021-01-26 23:01:00 -07:00 |
|
spbeach46
|
d09090dc13
|
deleted curate defs that work from json directly instead of pandas df
|
2021-01-24 22:46:55 -07:00 |
|
spbeach46
|
92516ff4f0
|
adding gameplan for constructing two csv file from pandas after shopping api call; for main data and training set
|
2021-01-23 01:38:04 -07:00 |
|
spbeach46
|
fd6fd04ecd
|
attempting curate by starting with pandas df first
|
2021-01-22 23:21:56 -07:00 |
|
spbeach46
|
b4e1961ace
|
working on curate_data to remove formatting issues in csv
|
2020-12-29 01:55:21 -07:00 |
|
spbeach46
|
dcbdb7ced3
|
need to fix data.update in conky to be list of dicts not dict of dicts
|
2020-12-29 00:20:55 -07:00 |
|
spbeach46
|
e6cf1b6a5d
|
fixed repeats and multithreading. Needs refining
|
2020-12-27 21:13:12 -07:00 |
|