Pyspark job - 1000 gz files with 1m json objs of 6KB each to 1B files in s3

I have done work in pyspark extensively. Alternatively we can use multithreading or multiprocessing also in python to achieve this. Let me know. I am really interested in this job. I am currently working as a Senior Data Engineer in an IT Company. I'm offering best quality and highest performance at a price we are both comfortable with. I can complete your project on time and your will experience great satisfaction with me. I'm well versed in Python,SQL,Unix Scripting, Excel VBA etc I have rich experienced in Word, PDF, Data Processing, Data Entry, Web Scraping. For more information about me, please refer to my portfolios. I'm ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details Thank you! Ashish Dudeja

Hi , I have experiance in pyspark and AWS let me know the details we can work on this to get it done.