Conversation
…Domino # Conflicts: # modules/TwintPool.py
…r "created at" datetime bug
…r "created at" datetime bug
…r "created at" datetime bug
…r "created at" datetime bug
…r "created at" datetime bug
| neo4j_df['user_followers_count'] = None | ||
| neo4j_df['user_friends_count'] = None | ||
| neo4j_df['date'] = df['date'] | ||
| # neo4j_df['user_created_at'] = None |
There was a problem hiding this comment.
@webcoderz afaict, and following the naming convention, neo4j_df['user_created_at'] is for user account creation date and neo4j_df['created_at'] for tweet creation date. So instead of adding neo4j['date'], we should put it in neo4j['user_created_at'] or neo4j['created_at']
There was a problem hiding this comment.
yea we don't really need it i made this commit before i noticed the bug with neo4jdf["created_at"] theyre both the same now .. in twint when you get the user info the user created date would be df["join_datetime"]
…reated_at column join_datetime
…reated_at column join_datetime
…reated_at column join_datetime
| 'user_created_at': pd.to_datetime( | ||
| df['user_created_at']) if 'user_created_at' in row else None, | ||
| row['join_datetime']) if 'join_datetime' in row else None, | ||
| 'user_profile_image_url': row[ |
There was a problem hiding this comment.
join_datetime seems to be in https://github.com/twintproject/twint/blob/master/twint/storage/panda.py#L125 , but the rest of the fields here aren't... surprised this works? but guessing manual tests were fine, so will just note it here in case need to revisit
There was a problem hiding this comment.
i removed it this morning , forgot i did account enrichments at a diff stage in the transformation when i committed this.
There was a problem hiding this comment.
going to do a round trip into neo today on everything
lmeyerov
left a comment
lmeyerov
left a comment
There was a problem hiding this comment.
Has this been tested w/ both tweet+acct timestamps etc all the way through neo4j roundtrip?
…d write into neo4j
…d write into neo4j
…d write into neo4j
…d write into neo4j
…d write into neo4j
…d write into neo4j
ghost
left a comment
ghost
left a comment
There was a problem hiding this comment.
@webcoderz I'm just now seeing this. Definitely got some skills.
2 participants
No description provided.