Import Rest API Data into SQL server using Azure Data Factory (ADF)

Đã Đóng Đã đăng vào 2 tháng trước Thanh toán khi bàn giao
Đã Đóng Thanh toán khi bàn giao

Hi There,

I have REST API and I need to import the data into a Azure SQL Server table.

I am using Azure Data Factory Data flow (attached) which was working fine but as the data grew I started getting the below error

Azure data factory REST API Job aborted due to stage failure: Serialized task 16:0 was bytes, which exceeds max allowed: [login to view URL] (134217728 bytes).

So I had to split the source API data into two parts using $top and $skip

Like below, two URL calls.

abc?$expand=xx,yy,zz&$top=40000&$skip=0

abc?$expand=xx,yy,zz&$top=40000&$skip=40000

I am looking for efficient way of doing it by using for loop or parametrization or anything which makes it work even if the data further grows.

Example API data : [login to view URL]$expand=Trips

If you can use above api and import all the data fields into SQL server.

ADF / Oracle ADF Azure Microsoft SQL Server JSON

ID dự án: #37514388

Về dự án

12 đề xuất Dự án từ xa 1 tháng trước đang mở

12 freelancer chào giá trung bình$43 cho công việc này

vw7590795vw

I read your requirement for Azure Data Factory. I will check your REST API data and help you to resolve your problem. I have good experience in import data at SQL Server. You can view my profile for completed project Thêm

$29 AUD trong 1 ngày
(15 Nhận xét)
3.9
akhileshgandhi

Hello, We would like to assist you with your requirements for importing Rest API data into a SQL server using Azure Data Factory (ADF). We have expertise in ADF, Oracle ADF, Azure, and Microsoft SQL Server. I underst Thêm

$30 AUD trong 7 ngày
(7 Nhận xét)
3.2
Samaji206

Hello I understand your request that you’re demanding Import Rest API Data into SQL server using Azure Data Factory (ADF) As a Professional Geeks, I can avail creative, proactive and high-tech solutions to your devel Thêm

$20 AUD trong 1 ngày
(0 Nhận xét)
0.0
durgesh8527

Hello there! My name is Pllavi and I am a full-time web and mobile app developer working as a freelancer. I understand that you need to import data from REST API into Azure SQL server using Azure Data Factory (ADF). Thêm

$30 AUD trong 7 ngày
(0 Nhận xét)
0.0
anayapallavi

I can Import Rest API Data into SQL server using Azure Data Factory. Please initiate a message for further discussion.

$50 AUD trong 2 ngày
(0 Nhận xét)
0.0
anaya8777

I can help you in Importing Rest API Data into SQL server using Azure Data Factory (ADF). Lets connect and discuss.

$50 AUD trong 2 ngày
(0 Nhận xét)
0.0
avetech2013

Hello Employer, How are you? Hope you are in your best spirits. I have 5 years of project management and virtual assistance experience in various industries. In my 10 years of IT programming experience working on t Thêm

$30 AUD trong 7 ngày
(0 Nhận xét)
0.0
fl0colin

For this task, we can use pagination rules to achieve your needs. I have tested with the example API you shared. Dataflow does not support range, but we can use one copy activity follow by your dataflow to flatten the Thêm

$40 AUD trong 5 ngày
(0 Nhận xét)
0.0