Đã Đóng

Use instructions to create a machine learning python notebook to train and call GPT-J model

I'm tired of negotiating infrastructure and TPUs and GPU and CUDA errors. I want code that works.

The deliverable for this project may be either of the following:

A Google Colab notebook (shared with me so I can make a copy)

A Paperspace Gradient python notebook (shared with me so I can make a copy)

A .ipynb notebook I can upload to one of those platforms. (Specify which platform. It has to work there.)

I have Google Colab Pro and/or am fine using paid instances on Paperspace. Your solution does not have to run for free. It just has to run.

Either as the first cell in the notebook or as a separate document, provide step-by-step instructions for setting up the environment. What do I need to select for the connection? Etc.

I will also accept ipynb code and instructions for some other paid service (AWS, Azure, Google Cloud, etc) but the instructions need to start from square one with the platform: What clusters do I need to set up? Where do I put this python code? How do I connect it to the training data and python code? Etc.

The notebook should be the code to create an instance of the GPT-J transformer-based text generation model, located here:

[login to view URL]

Program functionality:

Download/install GPT-J model and dependencies

Prepare the data (attached csv) for training

Train the model on the data

Save the tuned model

Call the tuned model

Using any sample prompt

The creators of the model also have a sample Collab notebook showing how to install and run the pre-trained model here:

[login to view URL]

Your notebook should then follow the fine-tuning instructions here: [login to view URL]

(The github training example above uses Google Cloud TPUs. You can use any of the above platforms.) Your instructions on how to perform the steps like creating the proper project, installing dependencies should be more detailed than the link above. Document every step so it is very clear.)

In text cells of the notebook, include detailed instructions on where to upload the training data. Then your code should prepare the data for training.

Your code should then execute fine-tuning on the attached data set for 2 epochs.

Acceptance criteria:

The deliverable is not the fine-tuned model. The deliverable is the notebook and any instructions, so that I can do this repeatably myself.. I will test your code by running the notebook code on the platform you indicate, using the instructions you give me. If I am successfully able to execute the steps above:

Download/install GPT-J model and dependencies

Prepare the data (attached csv) for training

Train the model on the data

Save the tuned model

Call the tuned model on a sample prompt.

Then the project is a success. I will not be evaluating the project based on the quality of the response generated in step 5, only that I can successfully run the code.

Note: The attached file is utf-8 format, but I think it may have been saved with a Byte Order Mark (BOM) for easy reading into Windows apps. Opening it with encoding='utf-8-sig' will ensure python can read it properly.

Additional resources:

You may find the notebook linked here helpful as well.

[login to view URL]

Kĩ năng: Python, Machine Learning (ML), Amazon Web Services, Điện toán đám mây, Google Cloud Platform

Xem nhiều hơn: data processing machine learning python, machine learning python, machine learning Python R, machine learning,python, sequence prediction machine learning python, github machine learning python, computer vision machine learning python, chatbot machine learning python, real time machine learning python, machine learning python assignment, machine learning python course, ocr machine learning python, machine learning python tutorial, azure machine learning python code, cancer detection using machine learning python, poker machine learning python, machine learning python stanford, cost function in machine learning python, coursera machine learning python, create machine learning model python

Về Bên Thuê:
( 4 nhận xét ) Fairburn, United States

ID dự án: #31012966

14 freelancer chào giá trung bình$262 cho công việc này

(71 Nhận xét)
7.1
(15 Nhận xét)
6.1
taranchenkovlady

Vladyslav is here. Andrea C I have +6 years of experience in Machine Learning && Artificial Intelligence && Website development. Especially I am good in: - Python/Django, JavaFx, Java spring boot,C++, C#, QT, ASP.NET, Thêm

$200 USD trong 3 ngày
(4 Nhận xét)
4.8
(35 Nhận xét)
5.0
iPingDataLabsLLP

Hi, Greetings for the day! We are a team of passionate Machine Learning Engineers based in Mumbai, India, who have developed and deployed complex AI solutions using Machine Learning and Computer Vision. We have a g Thêm

$500 USD trong 7 ngày
(8 Nhận xét)
4.6
(4 Nhận xét)
4.2
(5 Nhận xét)
4.4
KolaPeters

"Use instructions to create a machine learning python notebook to train and call GPT-J model" Hello, I’m a Data Scientist and Machine Learning engineer. My area of interest is statistical analysis of datasets/images Thêm

$30 USD trong 5 ngày
(5 Nhận xét)
4.0
Sandeep2805

Hello, Dear Client. Thanks for your posting! I am a machine learning expert with over 10 years of experience in tensorflow, darknet, keras, pytorch, opencv and open vino, etc. I have developed lots of LPR projects for Thêm

$140 USD trong 7 ngày
(6 Nhận xét)
3.5
artsiom1liaver

Hi, I am pleased to propose to your job. My Github profile: [login to view URL] After carefully reading and briefly understanding your proposal, I found out that you are looking for python, ML Expert. As Thêm

$250 USD trong 7 ngày
(3 Nhận xét)
3.1
amrmooohamed

Hello There, I have a profound practical knowledge in Machine learning, Deep learning, Computer vision, and NLP. Kindly find below a brief description of my skills and past projects. Waiting to discuss the job role wi Thêm

$250 USD trong 7 ngày
(0 Nhận xét)
0.0
blysh

Hi, there. Good day! Thanks for job posting. I've read your job requirements carefully and am very interesting in your project. *******************Why choose me?************** - My skill is match as your requirement Thêm

$140 USD trong 7 ngày
(0 Nhận xét)
0.0
harsh2244

Hi Hiring manager I am Data Scientist, Deep Learning, Machine Learning, Flask, Docker expert In my practice I developed for clients: * AI chat bot, algorithmic trading strategy * AI rating systems, analytics dash boa Thêm

$250 USD trong 2 ngày
(0 Nhận xét)
0.0
shafiqueqadri

Hi, I can help you with this. Since everything is provided in your job posting and I can begin working as soon as you want. I'm an ML expert with 5 years of experience. This job right in my scope. So let's jump to c Thêm

$200 USD trong 7 ngày
(0 Nhận xét)
0.0