• I develop Python scripts to extract data fromAPIs and convert it into various file formats.
• Following that, I conduct thorough data analysis, cleaning, and quality assurance checks before uploading to AWS S3.
• I design and develop ETL processes with Apache NiFi to extract, transform, and load enterprise data.
• This enables efficient loading into the Data Warehouse for comprehensive analysis and accessibility.
• Incorporating a Flask based script, I've developed a search and retrieve test case to optimize user experience.
• This feature efficiently queries and retrieves specific dataset information, enhancing usability significantly.
Flask Python data mining Web scraping data analysis