Showing posts with label old. Show all posts
Showing posts with label old. Show all posts

Friday, March 23, 2012

Package still referencing old parameters from an old connection

I deleted and created a new OLE DB connection string then set all my connections to that string in my components in my SSIS package however below where it talks about EBN_TEMP1, that's an old database table that no longer exists after I unistalled and reinstalled SQL Server on this box. Why is it still refrencing old stuff? Is there some sort of refresh I have to do on my entire package due to the fact that I

1) Reinstalled SQL Server 2005

2) Deleted an old OLE DB Conenction my package was using (based on an old database that was in the previous SQL Server install) and createad a new OLE DB Connection in my package to point to a new database name after my reinstall of SQL Server 2005

TITLE: Package Validation Error

Package Validation Error

ADDITIONAL INFORMATION:

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 0" and "AccountNumber" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 1" and "Screen" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 2" and "CaseNumber" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 3" and "BKYChapter" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 4" and "FileDate" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 6" and "DispositionCode" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 23" and "BKUDA1" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 24" and "RMSADDR2" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 25" and "RMSCMPNAME_1" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 26" and "RMSADDR_1" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 27" and "RMSCITY_1" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 28" and "RMSSTATECD_1" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 29" and "RMSZIPCODE_1" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 30" and "RMSWORKPHN" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 31" and "BKYMEETDTE" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [EBN_TEMP1 [528]]: Columns "Column 34" and "RMSCMPNAME_2" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [DTS.Pipeline]: "component "EBN_TEMP1" (528)" failed validation and returned validation status "VS_ISBROKEN".

Error at Data Flow Task [DTS.Pipeline]: One or more component failed validation.

Error at Data Flow Task: There were errors during task validation.

(Microsoft.DataTransformationServices.VsIntegration)

BUTTONS:

OK

I don't remember the format of error message, but this string (EBN_TEMP1) is probably the name of data flow component (source, destination, etc), not the connection name. Just look around the package to find an object with such name. Or double click the error message to get editor for this component.sql

Tuesday, March 20, 2012

Package dies after about 10000 seconds.

I have written a package that archives off old orders over night, it appears that this package is failing after about 10000 second every time it is run. I don't think it is memory as I am running it and checking for memory leaks.

Basic run down of package is

EXEcute SQL task to get orders to delete

If a for loop, loop each ordernumber

within the for loop there are 2 dataflow

dataflow 1

find related records in child tables (oldb connection using query)

using a mutli split first

check (with lookup) for records already in archive database

only copy on a fail from the look up

second

delete related records

dataflow 2

do the same but for the parent table

SP1 CTP is installed on server.

Any ideas?

You need to identify where the bottleneck is. Your log file should give some clues as to which task is taking a long time..

-Jamie

|||This might sound like a dumb question but were is my log file?|||

Not a dumb question at all.

You need to configure logging for your package. Right-click on the control-flow surface and select "Logging..."

-Jamie

|||If you have any connection to remote db's, you also want to check that. Some connection get lost or drop after runn continues for a couple of min, hour etc. (i happened to me once because the vendor from which i was downloading the data from had a batch process at their end that always interrupted my download)
Also, you can try doing batch insert to your achieve table by setting the Row per batch to a decent number. That may help it yours inserts are very very larg.

But first, check your loggs as jamei said

Saturday, February 25, 2012

Overwrite data file

Is there any way I can overwrite only one data file of the database with a
newer one? Both the files (old and new) belong to the same database but the
newer one has some additional data. Additional data was added in-house and
the same needs to be merged with the database at the client's site. Client's
database in the meatime has been collecting real time data which is stored on
a different file. Any help is appreciated. Thanks.No, SQL Server cannot guarantee a consistent database if it allowed such operation. And even if you
would try to force this, you will end up with a corrupt database. Just think of the correlation
between the data in the data pages and the entries in the transaction log.
So you need to look as some other means to do this, like providing the client with that data in a
file and BULK INSERT that data or similar.
--
Tibor Karaszi, SQL Server MVP
http://www.karaszi.com/sqlserver/default.asp
http://www.solidqualitylearning.com/
Blog: http://solidqualitylearning.com/blogs/tibor/
"KMP" <KMP@.discussions.microsoft.com> wrote in message
news:2B90AFBB-FEF7-430A-9D39-0CB787D2E1D3@.microsoft.com...
> Is there any way I can overwrite only one data file of the database with a
> newer one? Both the files (old and new) belong to the same database but the
> newer one has some additional data. Additional data was added in-house and
> the same needs to be merged with the database at the client's site. Client's
> database in the meatime has been collecting real time data which is stored on
> a different file. Any help is appreciated. Thanks.

Overwrite data file

Is there any way I can overwrite only one data file of the database with a
newer one? Both the files (old and new) belong to the same database but the
newer one has some additional data. Additional data was added in-house and
the same needs to be merged with the database at the client's site. Client's
database in the meatime has been collecting real time data which is stored o
n
a different file. Any help is appreciated. Thanks.No, SQL Server cannot guarantee a consistent database if it allowed such ope
ration. And even if you
would try to force this, you will end up with a corrupt database. Just think
of the correlation
between the data in the data pages and the entries in the transaction log.
So you need to look as some other means to do this, like providing the clien
t with that data in a
file and BULK INSERT that data or similar.
Tibor Karaszi, SQL Server MVP
http://www.karaszi.com/sqlserver/default.asp
http://www.solidqualitylearning.com/
Blog: http://solidqualitylearning.com/blogs/tibor/
"KMP" <KMP@.discussions.microsoft.com> wrote in message
news:2B90AFBB-FEF7-430A-9D39-0CB787D2E1D3@.microsoft.com...
> Is there any way I can overwrite only one data file of the database with a
> newer one? Both the files (old and new) belong to the same database but th
e
> newer one has some additional data. Additional data was added in-house and
> the same needs to be merged with the database at the client's site. Client
's
> database in the meatime has been collecting real time data which is stored
on
> a different file. Any help is appreciated. Thanks.

Overwrite data file

Is there any way I can overwrite only one data file of the database with a
newer one? Both the files (old and new) belong to the same database but the
newer one has some additional data. Additional data was added in-house and
the same needs to be merged with the database at the client's site. Client's
database in the meatime has been collecting real time data which is stored on
a different file. Any help is appreciated. Thanks.
No, SQL Server cannot guarantee a consistent database if it allowed such operation. And even if you
would try to force this, you will end up with a corrupt database. Just think of the correlation
between the data in the data pages and the entries in the transaction log.
So you need to look as some other means to do this, like providing the client with that data in a
file and BULK INSERT that data or similar.
Tibor Karaszi, SQL Server MVP
http://www.karaszi.com/sqlserver/default.asp
http://www.solidqualitylearning.com/
Blog: http://solidqualitylearning.com/blogs/tibor/
"KMP" <KMP@.discussions.microsoft.com> wrote in message
news:2B90AFBB-FEF7-430A-9D39-0CB787D2E1D3@.microsoft.com...
> Is there any way I can overwrite only one data file of the database with a
> newer one? Both the files (old and new) belong to the same database but the
> newer one has some additional data. Additional data was added in-house and
> the same needs to be merged with the database at the client's site. Client's
> database in the meatime has been collecting real time data which is stored on
> a different file. Any help is appreciated. Thanks.

overriding aggregate value of a measure to only total based on the children of the an attributes

Going off of Adventure Works, there's a product attribute:

[Product].[Product].[Product]

and now I also have an old product attribute:

[Product].[Old Product].[Old Product]

(people wanted to see the before and after view of different product assignment).

I also have a estimate of sales for each product and old product. When using just this measure - that amount is around twice as much as before - that's ok, but when using just product or just old product, I just want to see the sum of its children.

How could one define a calculated measure so that if the current level is [Product].[Product].All, then the aggregate should be the sum of the children?

This is sort of how I'd be using it:

select [estimated sales] on 0, [Product].[Product].[Product] on 1

from [Adventure Works]

the all line should be the sum of the measure used for all the children (new behavior) and each product row would have the the estimated sales - so this would stay the same.

thinking about this a little more - the 'All' level would be the curren tlevel if the attribute wasn't even used, so I'm not sure what to do to really depict which product attribute was added. And if a person added both? I'd probably want to just show the product totals.

What I'm going to try for now is add another dimension measure with an attribute defaulted to 1 and in the estimated sales, I'll add a 1 to the new records and a 0 to the old ones. This should address the issue that I have.

Thanks!