Skip to content

Tech Odyssey - The Web Exploration Engine (WEE) - WEE automates the extraction of critical website information. Employing cutting-edge scraping technologies and natural language processing, WEE delivers user-friendly insights and reports through an intuitive and responsive website

Notifications You must be signed in to change notification settings

COS301-SE-2024/Web-Exploration-Engine

Repository files navigation

Web Exploration Engine

A Capstone Project for Domain Name Services (Pty) Ltd.

GitHub issues GitHub pull requests GitHub pull requests GitHub pull requests GitHub pull requests lint-build-test-deploy codecov

WEE_Promo.mp4

The Web Exploration Engine (WEE) automates the extraction of critical website information. Employing cutting-edge scraping technologies and natural language processing, WEE delivers user-friendly insights and reports through an intuitive Progressive Web Application (PWA). With customised scraping capabilities, users can benefit from the power of web scraping for diverse needs, from market research and competitor analysis to lead generation.

Our Website | Summary Slides

Documentation and Resources

Resource Description
Software Requirements Specification Details on project requirements
Architectural Specification System design overview
User Manual Guidelines to using WEE
Technical Installation Manual Instructions for system configuration
Coding Standards Guidelines for writing code
Testing Policy Document Testing strategies and findings
Usability Testing Enhance usability and user experience
Contributing Guidelines for contributing to WEE
Architecture Diagram Diagram of system overview
Class Diagram Visual representation of WEE structure
Deployment Diagram Plan for project deployment
Project Board Team organisation and progress tracking
Previous Documentation Iterations See how our documentation has progressed

Demo Resources

Technologies

Frontend

Backend

Project Management & Deployment

Testing


Meet Tech Odyssey

Johané Breytenbach

Services Engineer, Data Engineer


I am a third-year BSc Information and Knowledge System student with a strong focus on Data Science modules and I am well-prepared to contribute significantly to the Web exploration project. My coursework in modules has provided me with a solid foundation in machine learning algorithms and data analysis techniques.

Mignon Erasmus

UI Engineer, Integration Engineer, DevOps Engineer


I am a third year BSc Information and Knowledge Systems student. My degree gives me a strong foundation in Computer Science and Software Development. I am an ambitious, high-achieving and curious individual who always strives for excellence. I find problem solving as an exhilarating experience where one can design and implement unique software solutions that can solve real world problems. I believe that in the ever evolving world of software engineering I am always open to feedback from fellow colleagues and experts to further improve my skills and knowledge. My tenacity ensures that I persist with a problem until I have unravelled it.

Siyamthanda Ndlovu

DevOps Engineer, Testing Engineer


As a final year computer science student, I am deeply engaged in honing my skills and evolving as a software developer and engineer. Currently, I am enrolled in the Artificial Intelligence (COS 314) module at my university, and I will be taking on the Computer Security and Ethics module (COS 330) in the upcoming semester this year. Over the past 14 months, I have actively participated as a member of various teams, from group projects in my degree modules to my work as a Computer Lab Technician. This experience has given me valuable insights into what it takes to deliver high-quality outcomes and has allowed me to leverage my skills to contribute as much as possible to the teams I am a part of.

Caitlin Simon

Project Manager, Integration Engineer, DevOps Engineer, Services Engineer


As a computer science student with a passion for data science, I bring valuable skills and a collaborative approach to this project. My experience in data science includes modules, such as Applications in data science (WST 212) and Artificial Intelligence (COS 314) through languages such as C++, Java and R. I gained practical experience through a quantitative science internship, Quantify Your Future where I was able to apply my theoretical knowledge in machine learning and data analytics to real-world problems in the financial sector.

Katlego Zondo

Services Engineer, Testing Engineer


I am a computer science student with a keen interest in software development. My foundation in computer science principles makes me a valuable asset. I have gained practical experience and honed my skills through hands-on projects during my academic journey. I take every situation as an opportunity to learn and grow, leveraging practical experiences in school to enhance my knowledge and expertise. I am driven by the idea of broadening my experiences and developing my abilities further. I view criticism as a constructive tool for improvement and am dedicated to continually challenging myself to reach new standards of performance.

About

Tech Odyssey - The Web Exploration Engine (WEE) - WEE automates the extraction of critical website information. Employing cutting-edge scraping technologies and natural language processing, WEE delivers user-friendly insights and reports through an intuitive and responsive website

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages