Page 1 of 1

Question about Azure SQL DW Upload Task

Posted: Thu 07 Jun 2018 16:47
by dburtsev
We need “Text qualifier” like in Flat File Connection.

Our files looks like this:
"ID"|"TXT"|"Num"|"DT"
1|"aaa|bbb|ccc"|2.4|19990102
2|"ddd|eee"|34.67|20180605

I can manually add STRING_DELIMITER = '"' but it will be manual editing and as result I lost Mapping and Columns pages functionality.
Thank you.

Re: Question about Azure SQL DW Upload Task

Posted: Mon 11 Jun 2018 14:17
by Pinturiccio
Please describe the issue in more details. As we understood, you have a flat file with the described structure. What are you doing with this file? Do you import data from this file into SQL Data Warehouse? What actions do you perform? What result do you expect, and what result do you actually get?

Re: Question about Azure SQL DW Upload Task

Posted: Tue 12 Jun 2018 13:12
by dburtsev
What are you doing with this file?
I am import data from this file into SQL Data Warehouse.

Do you import data from this file into SQL Data Warehouse?
Yes

What actions do you perform?
I am trying to use DevArt SSIS component - Azure SQL DW Upload Task

What result do you expect, and what result do you actually get?
I expect that all data from the file will be in Azure SQL DW.
┌──┬──────────┬────┬───────
│ID │ TXT │ Num│ DT
├──┼──────────┼────┼───────
│1 │ aaa|bbb|ccc│2.44 │1/2/1999
├──┼──────────┼────┼───────
│2 │ddd|eee │34.67 │ 6/5/2018
└──┴──────────┴────┴───────
This is the error message:
Column ordinal: 3, Expected data type: DECIMAL(12,2), Offending value: bbb (Column Conversion Error), Error: Error converting data type VARCHAR to DECIMAL.
Information: 0x0 at Azure SQL DW Upload Task, Azure SQL DW Upload Task: Cleaning-up file(s) uploaded to blob storage.
Information: 0x0 at Azure SQL DW Upload Task, Azure SQL DW Upload Task: Finished cleaning-up file(s) uploaded to blob storage.
Task failed: Azure SQL DW Upload Task
This is the table:
CREATE TABLE dbo.DevArt
(
ID INT NOT NULL PRIMARY KEY NONCLUSTERED NOT ENFORCED ,
TXT VARCHAR(60) NULL,
Num DECIMAL(12,2) NULL,
DT DATE NULL
)
WITH
(
DISTRIBUTION = ROUND_ROBIN,
CLUSTERED COLUMNSTORE INDEX
)
GO

Re: Question about Azure SQL DW Upload Task

Posted: Wed 13 Jun 2018 12:57
by Pinturiccio
dburtsev wrote:What actions do you perform?
I am trying to use DevArt SSIS component - Azure SQL DW Upload Task
Azure SQL DW Upload Task is not a Devart component. It is a Microsoft task and you should address your request to Microsoft support. Devart has no relation to Azure SQL DW Upload Task.