Home » Visual StudioRSS

Flat File Source Task Failure

Hello,

I have an ETL process where I am loading flat files int a table with a Foreach Loop task. I came accross a file that keeps failing the SSIS package as the Flat File Task tries to read it. Is there a way quick way to locate the problem within the Flat file (text file).

Here is the error:

[Flat File Source [1]] Error: The column data for column "Immediate Cash Amount" overflowed the disk I/O buffer.

[Flat File Source [1]] Error: An error occurred while skipping data rows.

Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Flat File Source" (1) returned error code 0xC0202091.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

Thanks

 

 

 

17 Answers Found

 

Answer 1

Hello Kajoo,

It must be the quality of your input (the source  file), afterall the buffers are limited, thus the error.

In some cases this could be empty lines, in others row separator is not standard, e.g. CRLF should be used, but anther value supplied.

You need to find out what record it hiccups at, the error  messages should include it, otherwise use logging to trap it.

 

Answer 2

Make use of Advanced configuration of flat  file source.

Set the error  configuration as redirect rows  on error. and sen this error record to a flat file  destination to check what the issue with the specific record?

If you cannot find any issue provide us the sample input records so that we can investigate.

 

Answer 3

I followed your instructions and created a flat  File Destination and in the Advanced configuration redirected the error  records to the Flat file  Destination. So I ran the package  and it failed and no records were sent to to the flat file because the package is failing  on the Flat File source  Tasks as it reads the data.

Thanks 

 

Answer 4

what is the error  you are getting?
 

Answer 5

[Flat file  Destination [70520]] Information: The processing of file "O:\ATMFiles\LogfileOutput\Error Records.txt" has started.

[Extract ATM Flat Files [58563]] Error: The column  data for column "Immediate Cash Amount" overflowed the disk  I/O buffer.

[Extract ATM Flat Files [58563]] Error: An error  occurred while skipping data  rows.

Error: SSIS Error code  DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method  on component  "Extract ATM Flat Files" (58563) returned  error code 0xC0202091.  The component returned a failure  code when the pipeline  engine called  PrimeOutput(). The meaning of the failure code is defined  by the component, but the error is fatal  and the pipeline stopped  executing.  There may be error messages  posted before this with more information  about the failure.

Error: SSIS Error Code DTS_E_THREADFAILED.  Thread "SourceThread0" has exited with error code 0xC0047038.  There may be error messages posted  before this with more information on why the thread has exited.

Error: SSIS Error Code DTS_E_THREADCANCELLED.  Thread "WorkThread0" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.  There may be error messages posted before this with more information on why the thread was cancelled.

Error: SSIS Error Code DTS_E_THREADCANCELLED.  Thread "WorkThread2" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.  There may be error messages posted before this with more information on why the thread was cancelled.

Error: SSIS Error Code DTS_E_THREADCANCELLED.  Thread "WorkThread1" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.  There may be error messages posted before this with more information on why the thread was cancelled.

[Extract ATM Flat Files [58563]] Information: The processing of file "O:\ATMFiles\AtmDialog20100714.txt" has ended.

 

Thanks

 

Answer 6

[Flat file  Destination [70520]] Information: The processing of file "O:\ATMFiles\LogfileOutput\Error Records.txt" has started.

[Extract ATM Flat Files [58563]] Error: The column  data for column "Immediate Cash Amount" overflowed the disk  I/O buffer.

[Extract ATM Flat Files [58563]] Error: An error  occurred while skipping data  rows.

Error: SSIS Error code  DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method  on component  "Extract ATM Flat Files" (58563) returned  error code 0xC0202091.  The component returned a failure  code when the pipeline  engine called  PrimeOutput(). The meaning of the failure code is defined  by the component, but the error is fatal  and the pipeline stopped  executing.  There may be error messages  posted before this with more information  about the failure.

Error: SSIS Error Code DTS_E_THREADFAILED.  Thread "SourceThread0" has exited with error code 0xC0047038.  There may be error messages posted  before this with more information on why the thread has exited.

Error: SSIS Error Code DTS_E_THREADCANCELLED.  Thread "WorkThread0" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.  There may be error messages posted before this with more information on why the thread was cancelled.

Error: SSIS Error Code DTS_E_THREADCANCELLED.  Thread "WorkThread2" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.  There may be error messages posted before this with more information on why the thread was cancelled.

Error: SSIS Error Code DTS_E_THREADCANCELLED.  Thread "WorkThread1" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.  There may be error messages posted before this with more information on why the thread was cancelled.

[Extract ATM Flat Files [58563]] Information: The processing of file "O:\ATMFiles\AtmDialog20100714.txt" has ended.

 

Thanks

 

Answer 7

Seems like the file  is corrupted in some way - either the CRLF is missing or some other formatting issue e.g. code  page exist.

You should concentrate your efforts on finding the offending line in the file.

You may use error  redirect to flag it off.


Arthur My Blog
By: TwitterButtons.com
 

Answer 8

Thanks! 

Yes! I agree, it looks like the file  is corrupt...I did use the redirct on error  feature...but it dose not redirect anything...this is what its outputing:

Flat File Source Error Output Column,ErrorCode,ErrorColumn

 

 

Answer 9

What is the column  delimiter? What is the raw delimiter?

You may want to open this file  in an editor that show hidden chars.

 

Answer 10

What kind of editor is that? Is there a specific Editor that I should use...because I am using EditPlus and I haven't been able to locate  anything yet...there are too many columns and records...thanks
 

Answer 11

I use Notepad++ go to View - Show Symbol to enable whatever makes sense.
 

Answer 12

Kajoo - use the preview option in your flat  file source  adapter and check if a correct ouput is given or not. It will also show you the CRLF's in your file. YOu won't be able to redirect the error  rows as your flat file  source adapter itself is failing.
 

Answer 13

Thanks for the tip...I downloaded Notepad ++ andView section of the toolbar, under show symbols, I selected show all charctors and I already can see that the file  is missing something.

In the files  that work without any erros I notice that at the end of each record it has CR LF...

however at the end of each record for the file that errors out, it only has LF

That looks abornmal to me...now I have to figure out how to use Notepad ++ to change the corrupt file to show at the end of each record CR LF as well...any ideas?

Thanks

 

Answer 14

It might be that you received a bogus input file, so your supplier needs the change.

You can only replace the LF to CRLF not to set Notepad++, it shows what it is.

 

Answer 15

Are we able to change the LFs to CRLF in Notepad++?
 

Answer 16

I would do it using a vbscript. I would probe first for LF is present, if so sabstitute to vbCRLF. Like Replace(strFileLine, vbLf, vbCrLf)
 

Answer 17

Thanks for the help...I am going to open another trace for VB, because I have no experience with VB at all.
 
 
 

<< Previous      Next >>


Microsoft   |   Windows   |   Visual Studio   |   Follow us on Twitter