I'm working on a project involving a Python application with multiple interacting modules and am looking for some advice on deploying it efficiently on Google Cloud Platform. Here's a brief overview of what the application entails:
Functionality Overview:
- Data Fetching: One module fetches data from external websites.
- Data Extraction: Another module extracts data from another GCP project.
- Data Processing: Variables are processed across various modules.
- CSV Output: The app generates and stores CSV files.
- Scheduled Running: The application should run automatically once daily.
I would greatly appreciate your insights on the following questions:
- What are the best GCP services to use for this type of application?
- Recommended Python libraries for handling web data retrieval in this case?
- How to proceed step by step? I intend to first deploy my Python application using placeholder inputs and simple printed outputs. Then, I plan to integrate the data fetching component and implement the creation and storage of CSV files. Does this strategy seem logical to you?
Thank you in advance for your help!
Currently, I only tried to deploy my Python code using Google Cloud Functions, but I find this method impractical because I must deploy each module separately. I would prefer a solution that allows me to deploy all my code at once, where the Python modules can smoothly pass variables among themselves.