Skip to content
Closed
Changes from 1 commit
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
d6dcaff
fixing search username function due to twint deprecation
webcoderz Aug 18, 2020
a80fd10
Merge branch 'master' of https://github.com/TheDataRideAlongs/Project…
webcoderz Aug 18, 2020
1952dec
Merge branch 'master' of https://github.com/TheDataRideAlongs/Project…
webcoderz Dec 26, 2020
dace204
user info, replies, and user timeline inline with twint and bugfix fo…
webcoderz Dec 26, 2020
a21425d
user info, replies, and user timeline inline with twint and bugfix fo…
webcoderz Dec 26, 2020
22703c3
user info, replies, and user timeline inline with twint and bugfix fo…
webcoderz Dec 26, 2020
1b25c1d
user info, replies, and user timeline inline with twint and bugfix fo…
webcoderz Dec 26, 2020
7be53b0
user info, replies, and user timeline inline with twint and bugfix fo…
webcoderz Dec 26, 2020
c15740e
changed user_Created_At twint df inferrence inline with twints user c…
webcoderz Dec 27, 2020
89ed4d6
changed user_Created_At twint df inferrence inline with twints user c…
webcoderz Dec 27, 2020
f6f2923
changed user_Created_At twint df inferrence inline with twints user c…
webcoderz Dec 27, 2020
7ea6ca5
adding quo
webcoderz Dec 28, 2020
53367f3
removed user created at from initial conversion
webcoderz Dec 28, 2020
b967545
Update Neo4jDataAccess.py
webcoderz Dec 28, 2020
604e5a6
enrich_user_tl_and_info function to grab a users timeline and info an…
webcoderz Dec 28, 2020
d57ee6d
enrich_user_tl_and_info function to grab a users timeline and info an…
webcoderz Dec 28, 2020
c5d6096
enrich_user_tl_and_info function to grab a users timeline and info an…
webcoderz Dec 28, 2020
dbfa95e
enrich_user_tl_and_info function to grab a users timeline and info an…
webcoderz Dec 28, 2020
08838d4
enrich_user_tl_and_info function to grab a users timeline and info an…
webcoderz Dec 28, 2020
a39bdc5
enrich_user_tl_and_info function to grab a users timeline and info an…
webcoderz Dec 28, 2020
91eeed0
timestamp to date time conversion for neo
webcoderz Dec 28, 2020
8b1ae3d
timestamp to date time conversion for neo
webcoderz Dec 28, 2020
6b81244
timestamp to date time conversion for neo
webcoderz Dec 28, 2020
cebae1f
timestamp to date time conversion for neo
webcoderz Dec 30, 2020
43c2ac8
timeline writer for enrich_user_tl_and_info functionality.
webcoderz Dec 30, 2020
72843ab
timeline writer for enrich_user_tl_and_info functionality.
webcoderz Dec 30, 2020
f6a89b8
timeline writer for enrich_user_tl_and_info functionality.
webcoderz Dec 31, 2020
f5b70c9
timeline writer for enrich_user_tl_and_info functionality.
webcoderz Jan 3, 2021
21cd16f
adding flag to pull retweets
webcoderz Jan 19, 2021
File filter

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
timeline writer for enrich_user_tl_and_info functionality.
  • Loading branch information
webcoderz committed Dec 30, 2020
commit 43c2ac8f7df61e164875b7d10b0dfe2f6371da3f
8 changes: 1 addition & 7 deletions modules/Neo4jDataAccess.py
Original file line number Diff line number Diff line change
Expand Up @@ -487,13 +487,7 @@ def enrich_user_tl_and_info(self,username, job_name,job_id, limit, include_profi
logger.info(f'finished account and data enrichments in: {toc - tic:0.4f} seconds writing to neo4j now..')
self.write_twint_enriched_tweetdf_to_neo(res, job_name, job_id)
else:
tic = time.perf_counter()
chk = TwintPool().twint_df_to_neo4j_df(TwintPool()._get_user_timeline(username=username, limit=limit))
chk["tweet_id"]=chk["status_id"]
res = {"params": chk}
toc = time.perf_counter()
logger.info(f'finished account and data enrichments in: {toc - tic:0.4f} seconds writing to neo4j now..')
self.write_twint_enriched_tweetdf_to_neo(res, job_name, job_id)
self.save_twintdf_to_neo(TwintPool()._get_user_timeline(username=username, limit=limit),job_name=job_name, job_id=job_id)

def save_twintdf_to_neo(self, df, job_name, job_id=None):
if (df is None) or (len(df) == 0):
Expand Down