Question about Azure SQL DW Upload Task

Discussion of issues, suggestions and bugs of Devart SSIS Data Flow Components, our product line for building SSIS-based ETL solutions, performing data access to popular cloud applications and databases.
Post Reply
dburtsev
Posts: 8
Joined: Wed 18 Jan 2017 19:57

Question about Azure SQL DW Upload Task

Post by dburtsev » Thu 07 Jun 2018 16:47

We need “Text qualifier” like in Flat File Connection.

Our files looks like this:
"ID"|"TXT"|"Num"|"DT"
1|"aaa|bbb|ccc"|2.4|19990102
2|"ddd|eee"|34.67|20180605

I can manually add STRING_DELIMITER = '"' but it will be manual editing and as result I lost Mapping and Columns pages functionality.
Thank you.

Pinturiccio
Devart Team
Posts: 2420
Joined: Wed 02 Nov 2011 09:44

Re: Question about Azure SQL DW Upload Task

Post by Pinturiccio » Mon 11 Jun 2018 14:17

Please describe the issue in more details. As we understood, you have a flat file with the described structure. What are you doing with this file? Do you import data from this file into SQL Data Warehouse? What actions do you perform? What result do you expect, and what result do you actually get?

dburtsev
Posts: 8
Joined: Wed 18 Jan 2017 19:57

Re: Question about Azure SQL DW Upload Task

Post by dburtsev » Tue 12 Jun 2018 13:12

What are you doing with this file?
I am import data from this file into SQL Data Warehouse.

Do you import data from this file into SQL Data Warehouse?
Yes

What actions do you perform?
I am trying to use DevArt SSIS component - Azure SQL DW Upload Task

What result do you expect, and what result do you actually get?
I expect that all data from the file will be in Azure SQL DW.
┌──┬──────────┬────┬───────
│ID │ TXT │ Num│ DT
├──┼──────────┼────┼───────
│1 │ aaa|bbb|ccc│2.44 │1/2/1999
├──┼──────────┼────┼───────
│2 │ddd|eee │34.67 │ 6/5/2018
└──┴──────────┴────┴───────
This is the error message:
Column ordinal: 3, Expected data type: DECIMAL(12,2), Offending value: bbb (Column Conversion Error), Error: Error converting data type VARCHAR to DECIMAL.
Information: 0x0 at Azure SQL DW Upload Task, Azure SQL DW Upload Task: Cleaning-up file(s) uploaded to blob storage.
Information: 0x0 at Azure SQL DW Upload Task, Azure SQL DW Upload Task: Finished cleaning-up file(s) uploaded to blob storage.
Task failed: Azure SQL DW Upload Task
This is the table:
CREATE TABLE dbo.DevArt
(
ID INT NOT NULL PRIMARY KEY NONCLUSTERED NOT ENFORCED ,
TXT VARCHAR(60) NULL,
Num DECIMAL(12,2) NULL,
DT DATE NULL
)
WITH
(
DISTRIBUTION = ROUND_ROBIN,
CLUSTERED COLUMNSTORE INDEX
)
GO

Pinturiccio
Devart Team
Posts: 2420
Joined: Wed 02 Nov 2011 09:44

Re: Question about Azure SQL DW Upload Task

Post by Pinturiccio » Wed 13 Jun 2018 12:57

dburtsev wrote:What actions do you perform?
I am trying to use DevArt SSIS component - Azure SQL DW Upload Task
Azure SQL DW Upload Task is not a Devart component. It is a Microsoft task and you should address your request to Microsoft support. Devart has no relation to Azure SQL DW Upload Task.

Post Reply