Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Keyword search/Database Structure #3

Open
easherma opened this issue Jul 19, 2017 · 1 comment
Open

Keyword search/Database Structure #3

easherma opened this issue Jul 19, 2017 · 1 comment
Assignees
@easherma

Comments

@easherma
Copy link
Member

easherma commented Jul 19, 2017 •
edited by nermolov
Loading

Need a way to search keywords, KISS, TBD

This goes along with determining a database structure
@easherma easherma self-assigned this Jul 19, 2017
@nermolov nermolov changed the title Keyword search Keyword search/Database Structure Aug 9, 2017
@easherma
Copy link
Member Author

For now we're using Jupyter/iPython Notebooks and reading the flat files we wrote to disk.

The slowest part is having Beautiful Soup parse the xml, but loading transcripts into Pandas and then searching them seems pretty snappy. We're not dealing with a ton of data here and the transcripts won't really change, so I'm contemplating going with a NoSQL/document based solution over something more heavyweight.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@easherma easherma

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@easherma