Importing Data Stored in Python's Memory into MySQL: A Guide in Python Environment

How do I import data stored in the memory of my python environment using MySQL in Python environment?

When exploring a DataCamp notebook, I encountered a scenario where the author seamlessly transitioned from Python to SQL queries. Attempting to replicate this process, I encountered challenges due to the absence of guidance on how to execute SQL queries within Python outside of prebuilt environments. In this post, I detail my journey to successfully import data from Python's memory into a MySQL database.

1. Setting Up MySQL: To initiate the process, I installed MySQL from MySQL Downloads, ensuring access to a database and server for SQL query processing.

2. Installing Required Packages: Using Anaconda prompt, I installed pymysql to enable Python to interact with MySQL databases seamlessly. Following the same process, I installed sqlalchemy, a prerequisite for connecting Python to MySQL.

3. Connecting MySQL to Python: As a beginner, identifying the host and database names proved challenging(So, I am attaching the screenshot where I found the info in MySQL workbench).

4. Creating Engine and DataFrame: With MySQL connected, I created an engine and converted the desired table, named 'raw_data', stored in Python's memory into a DataFrame. This allowed for the seamless integration of Python's data into SQL queries.

5. Executing SQL Query: Leveraging the DataFrame and SQL, I executed queries. For instance, I ran a query to count occurrences of specific variables while grouping and sorting them accordingly.

6. Verification and Iteration: Before finalizing the process, I iteratively checked the query's output to ensure its accuracy and alignment with the desired outcome.

By meticulously documenting each step and overcoming obstacles along the way, I successfully navigated the process of importing data stored in Python's memory into a MySQL database. Through this journey, I not only gained a deeper understanding of Python-MySQL integration but also honed my problem-solving skills as a self-taught learner.

My entire code: (will be uploaded soon. I am still working on it)