Showing posts with label master. Show all posts
Showing posts with label master. Show all posts

Monday, March 26, 2012

Package variables

Couldn't quite find the answer I was looking for via a forum search.

I have 9 packages that are currently called by a master package - all child packages take a datetime variable from the master package which is subsequently used in the child processes.

The question I have is that if I run the master package manually from Visual Studio I can set the master package variable manually to a date of my choosing and run it, which works fine. However we will be wishing to automate the package execution at some point and want to know the best way to run the package(s) on an automated basis and have the data variable supplied to the master package.

What would be the best way to do this ?

Presently we have a variable called MasterPackage_vLoaddate which is a DateTime data type.

Any help appreciated.

You can use the /SET option of dtexec.exe to set your variable at run time.

Or, you can use expressions on that variable if you want to use something like getdate().|||

Thanks Phil..

OK.. you'll need to tell me take me thru this in a little more basic detail

Let's say I wanted to run this job at 07:00 every morning. The variable (date) should always be for the prior day.

So I am guessing i'd need to use somthing like

dateadd(day,-1,getdate())

Can I just add that to the package in VS ? Or where exactly would I use this in order to set the variable correctly. Sorry for being such a noob!!

|||Yes, you have the correct formula.

So, in the properties of the variable you wish to work with, set "EvaluateAsExpression" equal to true. Then, in the "expression" parameter, add your formula. It's that simple.

Every time the package runs, this formula will be evaluated.|||

Will,

Keep in mind that if you want the ability of running the package for any date you choose, you would need to put extra logic on this (e.g. you need to reprocess a day that is not the current day; or if for some reason the package did not run in a specifc day).

You could easily implemnet that logic with a table that keeps track of the executions dates.

Just my two cents

|||

OK...

I'll test that in the morning. I used

set "EvaluateAsExpression" equal to true

and then used the formula getdate("d",-1,getdate())

I am supposing that it will just be a straightforward job of scheduling the master package run in SQL Agent and then the other packages will be called as per expectations ?

Cheers... your reply helped

|||

Will Riley wrote:

I am supposing that it will just be a straightforward job of scheduling the master package run in SQL Agent and then the other packages will be called as per expectations ?

Yep, that should be pretty straightforward.|||

Hi Rafael,

I do already have a table that logs package execution so that in theory, the same day cannot be processed twice. Would you suggest that I derive the date variable from that table (i.e. max date + 1 i.e. something like a SQL command.... SELECT dateadd("d",1,MAX(load_dates.date)) )

If so , how would I pass that to the package ? it might be something I hold in reserve in case the above proves unworkable from Phil.

Cheers

|||

Will Riley wrote:

Hi Rafael,

I do already have a table that logs package execution so that in theory, the same day cannot be processed twice. Would you suggest that I derive the date variable from that table (i.e. max date + 1 i.e. something like a SQL command.... SELECT dateadd("d",1,MAX(load_dates.date)) )

If so , how would I pass that to the package ? it might be something I hold in reserve in case the above proves unworkable from Phil.

Cheers

My solution will work, it just won't be as flexible as Rafael's.

For the table derived option, use an Execute SQL task in the control flow to select the max(date)+1 and then store the result into your package's date variable.|||

Just one more thing....

Am I likely to run in to an issue with times?

The above solution will equate to a datetime value of something like

11/02/2007 07:00

I would rather have

11/02/2007 00:00

As there may well be issues if the time is anything other than 00:00

Is there a simple bit of SSIS "expression" that will evaluate to "yesterday" at 00:00 ?

|||

Will Riley wrote:

Just one more thing....

Am I likely to run in to an issue with times?

The above solution will equate to a datetime value of something like

11/02/2007 07:00

I would rather have

11/02/2007 00:00

As there may well be issues if the time is anything other than 00:00

Is there a simple bit of SSIS "expression" that will evaluate to "yesterday" at 00:00 ?

Put this in front of your formula: (DT_DBTIMESTAMP)(DT_DBDATE)

So you would have:
(DT_DBTIMESTAMP)(DT_DBDATE)dateadd("d",-1,getdate())


If you don't even want the 00:00 on the end, don't include the (DT_DBTIMESTAMP) cast.|||

Phil Brammer wrote:


My solution will work, it just won't be as flexible as Rafael's.

I never meant it won't work. I just wanted to add a point I thought was important to get that issue solved.

|||

Will Riley wrote:

Hi Rafael,

I do already have a table that logs package execution so that in theory, the same day cannot be processed twice. Would you suggest that I derive the date variable from that table (i.e. max date + 1 i.e. something like a SQL command.... SELECT dateadd("d",1,MAX(load_dates.date)) )

If so , how would I pass that to the package ? it might be something I hold in reserve in case the above proves unworkable from Phil.

I think the approach beeing discussed would work fine; you just need to base the logic on that table you already have (good you already have it!).

Having a logic that depends in 'today' date is asking for trouble in long long term; when things do not happen/run as expected.

|||

Rafael Salas wrote:

I never meant it won't work. I just wanted to add a point I thought was important to get that issue solved.

I agree. Will mentioned it.|||

Phil, Rafael,

Thanks both - between you you provided both the answer(s) I needed and some good advice in terms of the use/dangers of dynamic variables.

Cheers

Friday, March 23, 2012

Package Time Outs

Okay, we have are running our Master Package (and therefore all related Child packages) through a .bat file. The .bat file is scripted using the following logic for an entire month of daily runs:

Code Snippet

DTExec /FILE E:\ETL\FinancialDataMart\Master.dtsx /DECRYPT masterpwd /SET \Package.Variables[ReportingDate].Value;"2/01/2007" > E:\ETL\ErrorLogs\Processing\etl_20070201log.txt
IF NOT %ERRORLEVEL%==0 GOTO ERROR%ERRORLEVEL%
mkdir E:\ETL\ErrorLogs\Archive\20070201
move E:\ETL\ErrorLogs\Processing\*.txt E:\ETL\ErrorLogs\Archive\20070201


DTExec /FILE E:\ETL\FinancialDataMart\Master.dtsx /DECRYPT masterpwd /SU /SET \Package.Variables[ReportingDate].Value;"2/02/2007" > E:\ETL\ErrorLogs\Processing\etl_20070202log.txt
IF NOT %ERRORLEVEL%==0 GOTO ERROR%ERRORLEVEL%
mkdir E:\ETL\ErrorLogs\Archive\20070202
move E:\ETL\ErrorLogs\Processing\*.txt E:\ETL\ErrorLogs\Archive\20070202

etc...

Generally it takes about 40-45 minutes to run one days worth of data. However, we have found unpredictable instances where the job will take 3 hours or even 6 hours and appear to hang....

The weirdness sets in when we kill the job and rerun it. In all instances of a rerun, the job will execute in the normal 40-45 minute time frame. Obviously, we would like to institute some sort of logging, monitoring and error handling....including if need be a method to timeout a process and restart it.

I am reviewing the WMI (Windows Management Instrumentation) Task but I'm not entirely convinced that it's the right tool for the job.

Questions:

    Has anyone else experienced the type of processing behavior that I described? Has anyone been successful at using WMI or another process to monitor and timeout packages? If so, are there sample packages or a good tutorial that maps it out? Unrelated to this issue, we also have instances incomplete processing logs. The logs don't finish writing and the weird part is that they all end at the same point, does anyone have experience with incomplete job logs?:

    Code Snippet

    Progress: 2007-06-20 12:46:49.87
    Source: Update factFinancial Data Flow
    Cleanup: 11% complete

Thanks in advance!

Sounds like you're encountering some sort of deadlock. It's not clear to me whether or not you've enabled logging in all the packages; have you?

Have you installed SP2? We added some more logging in SP2 around calls to external databases.

You shouldn't need to kill the packages, but if you really, really want to go that way, you could use a Execute Process tasks (calling DTExec) instead of the Execute Package tasks, and set the TimeOut TerminateProcessAfterTimeout properties.

Wednesday, March 21, 2012

Package execution stability ?

I am running into some issue that i have found any good clue on this forum... although have seen a few threads dicussions. I have a master package which invokes a dozen of child packages.

1) If I only open master package inside IDE, I am keeping getting the following error when i run the master packages inside Visual Studio 2005 IDE.

The connection type "FLATFILE" specified for connection manager "XXXXX Flat File Destination Connection Manager" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name

2) If I opened up all child packages inside IDE, the master package run fine most of time.

Any suggestions?

Are you using a connection type of "flat file" or just the "file" connection manager type?|||

See below please

|||

It is a flat file type: Here is the error details:

Code Snippet

Error: 0xC0014005 at : The connection type "FLATFILE" specified for connection manager "Load Ready Output Connection Manager" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

Error: 0xC0010018 at : Error loading value "-1Load Ready Output Connection Manager{3A5E4ACC-9BF" from node "DTS:ConnectionManager".

Error: 0xC00220DE at Process Provider Data: Error 0xC0010014 while loading package file "C:\SSIS\newDas\Provider.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.

But I also get this Error in the same time.

Code Snippet

Error: 0xC0014005 at : The connection type "OLEDB" specified for connection manager "Target Database Connection" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

Error: 0xC0010018 at : Error loading value "-1Target Database Connection{CBD29A65-2BBC-4BB6-AED" from node "DTS:ConnectionManager".

Error: 0xC00220DE at Process BenefitPlan Data: Error 0xC0010014 while loading package file "C:\SSIS\newDas\BenefitPlan.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.

SO IT SEEMS THAT THE CONNECTION TYPE IS NOT RECOGNIZED FOR SOME WEIRD REASONS BEHIND....

Help..........

|||

Try to look at this thread and see if the answer solves your problem:

http://forums.microsoft.com/MSDN/ShowPost.aspx?PageIndex=4&SiteID=1&PostID=363238&PageID=1

Thanks,

Ovidiu Burlacu

|||

Thanks. Unfortunately, the link did NOT fix my problem.

I followed Mike's suggestion by creating the application and a non-administrative account. I did not see any incorrect registry key dosplayed. Help !!!

|||What version of SSIS do you have? RTM? SP1? SP2?

Seems like something is corrupt. Any changes to the system recently?|||

I have tried packages on various machines (RTM on Windows 2003, SP2 on Windows xp Pro ) and the error is repeatable on any machines.

Here is the version info for SSIS from "About" on Visual Studio 2005.

Microsoft SQL Server Integration Services Designer Version 9.00.3042.00

|||Microsoft follow-up:

I can create a simple package (OLE DB Source -> Flat File Destination) and recreate this error by opening the resulting .dtsx file in my favorite text editor. When doing so, searching by CaSE and replacing "FLATFILE" with "FLATFILE2" yields the same error message as Steve has indicated. Obviously, FLATFILE2 is not a valid connection manager type. So, with that said, where is the validation occurring to determine if the connection manager type is valid or not? And what can Steve do about it?|||

Thanks Phil for attention.

Here is complete info from package log in attempt to get help here. Any help will be greatly appreciated.

Code Snippet

#Fields: event,computer,operator,source,sourceid,executionid,starttime,endtime,datacode,databytes,message
PackageStart,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:04:56 PM,7/17/2007 3:04:56 PM,0,0x,Beginning of package execution.

OnError,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073659899,0x,The connection type "FLATFILE" specified for connection manager "MembersWithUpdates" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

OnError,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073659899,0x,The connection type "FLATFILE" specified for connection manager "MembersWithUpdates" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

OnError,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073676264,0x,Error loading value "<DTS:ConnectionManager xmlns:DTS="www.microsoft.com/SqlServer/Dts"><DTS:Property DTS:Name="DelayValidation">-1</DTS:Property><DTS:Property DTS:Name="ObjectName">MembersWithUpdates</DTS:Property><DTS:Property DTS:Name="DTSID">{D6867FEB-27D8-4576-80CB-A53449" from node "DTS:ConnectionManager".

OnError,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073676264,0x,Error loading value "<DTS:ConnectionManager xmlns:DTS="www.microsoft.com/SqlServer/Dts"><DTS:Property DTS:Name="DelayValidation">-1</DTS:Property><DTS:Property DTS:Name="ObjectName">MembersWithUpdates</DTS:Property><DTS:Property DTS:Name="DTSID">{D6867FEB-27D8-4576-80CB-A53449" from node "DTS:ConnectionManager".

OnError,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073602338,0x,Error 0xC0010014 while loading package file "C:\SSIS\DasLoader\Member.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.
.

OnError,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073602338,0x,Error 0xC0010014 while loading package file "C:\SSIS\DasLoader\Member.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.
.

OnTaskFailed,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,0,0x,(null)
PackageStart,MyComputerNameG,DomanName\MyUserAccount,BenefitPlan,{48289F86-1429-44B0-B5F7-295F31B6F39E},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:22 PM,7/17/2007 3:05:22 PM,0,0x,Beginning of package execution.

PackageStart,MyComputerNameG,DomanName\MyUserAccount,CustomInformationCodeLookup,{C4C5D8F8-CD26-4C94-ADB4-D40607F67D70},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:29 PM,7/17/2007 3:05:29 PM,0,0x,Beginning of package execution.

PackageStart,MyComputerNameG,DomanName\MyUserAccount,Provider,{6F1B4233-8A08-4688-827F-FB98DC7F975F},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:30 PM,7/17/2007 3:05:30 PM,0,0x,Beginning of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,CustomInformationCodeLookup,{C4C5D8F8-CD26-4C94-ADB4-D40607F67D70},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:31 PM,7/17/2007 3:05:31 PM,0,0x,End of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,BenefitPlan,{48289F86-1429-44B0-B5F7-295F31B6F39E},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:36 PM,7/17/2007 3:05:36 PM,0,0x,End of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,Provider,{6F1B4233-8A08-4688-827F-FB98DC7F975F},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:47 PM,7/17/2007 3:05:47 PM,0,0x,End of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:47 PM,7/17/2007 3:05:47 PM,0,0x,End of package execution.

|||

Hi Steve,

Just came across this page in Microsoft support site. See if this helps you.

http://support.microsoft.com/kb/913817/en-us

Regards

Saurabh

|||

Saurabh Kulkarni wrote:

Hi Steve,

Just came across this page in Microsoft support site. See if this helps you.

http://support.microsoft.com/kb/913817/en-us

Regards

Saurabh

He's followed the steps in that KB article already and no "bad" registry keys were identified.

|||[Microsoft follow-up]
again.

Come on guys.|||

something looks funny with this text from the error message:

Error loading value "-1Load Ready Output Connection Manager{3A5E4ACC-9BF" from node

almost as if the xml parsing has gone bad. the guid is chopped off and the string starts with -1.

do you have any objects with odd characters in the names. characters that could mess up a parser like < > " , - etc. ?

|||

Thanks for Microsoft's help coming out...

No, I checked packages and do not have/see any objects that contains weird name etc. Please take a look at my longer posting above.

The observation is that all of packages run successfully sometimes, while failed on the other times. It is not stable. I repeatedly re-run my packages above yesterday without any failure. But today it starts to fail occasionally.

If the packages contains object names with special characters, the packages should always fail.

I would be very willing to send you via email the four small and simple packages.

Steve

sql

Package execution stability ?

I am running into some issue that i have found any good clue on this forum... although have seen a few threads dicussions. I have a master package which invokes a dozen of child packages.

1) If I only open master package inside IDE, I am keeping getting the following error when i run the master packages inside Visual Studio 2005 IDE.

The connection type "FLATFILE" specified for connection manager "XXXXX Flat File Destination Connection Manager" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name

2) If I opened up all child packages inside IDE, the master package run fine most of time.

Any suggestions?

Are you using a connection type of "flat file" or just the "file" connection manager type?|||

See below please

|||

It is a flat file type: Here is the error details:

Code Snippet

Error: 0xC0014005 at : The connection type "FLATFILE" specified for connection manager "Load Ready Output Connection Manager" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

Error: 0xC0010018 at : Error loading value "-1Load Ready Output Connection Manager{3A5E4ACC-9BF" from node "DTS:ConnectionManager".

Error: 0xC00220DE at Process Provider Data: Error 0xC0010014 while loading package file "C:\SSIS\newDas\Provider.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.

But I also get this Error in the same time.

Code Snippet

Error: 0xC0014005 at : The connection type "OLEDB" specified for connection manager "Target Database Connection" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

Error: 0xC0010018 at : Error loading value "-1Target Database Connection{CBD29A65-2BBC-4BB6-AED" from node "DTS:ConnectionManager".

Error: 0xC00220DE at Process BenefitPlan Data: Error 0xC0010014 while loading package file "C:\SSIS\newDas\BenefitPlan.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.

SO IT SEEMS THAT THE CONNECTION TYPE IS NOT RECOGNIZED FOR SOME WEIRD REASONS BEHIND....

Help..........

|||

Try to look at this thread and see if the answer solves your problem:

http://forums.microsoft.com/MSDN/ShowPost.aspx?PageIndex=4&SiteID=1&PostID=363238&PageID=1

Thanks,

Ovidiu Burlacu

|||

Thanks. Unfortunately, the link did NOT fix my problem.

I followed Mike's suggestion by creating the application and a non-administrative account. I did not see any incorrect registry key dosplayed. Help !!!

|||What version of SSIS do you have? RTM? SP1? SP2?

Seems like something is corrupt. Any changes to the system recently?|||

I have tried packages on various machines (RTM on Windows 2003, SP2 on Windows xp Pro ) and the error is repeatable on any machines.

Here is the version info for SSIS from "About" on Visual Studio 2005.

Microsoft SQL Server Integration Services Designer Version 9.00.3042.00

|||Microsoft follow-up:

I can create a simple package (OLE DB Source -> Flat File Destination) and recreate this error by opening the resulting .dtsx file in my favorite text editor. When doing so, searching by CaSE and replacing "FLATFILE" with "FLATFILE2" yields the same error message as Steve has indicated. Obviously, FLATFILE2 is not a valid connection manager type. So, with that said, where is the validation occurring to determine if the connection manager type is valid or not? And what can Steve do about it?|||

Thanks Phil for attention.

Here is complete info from package log in attempt to get help here. Any help will be greatly appreciated.

Code Snippet

#Fields: event,computer,operator,source,sourceid,executionid,starttime,endtime,datacode,databytes,message
PackageStart,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:04:56 PM,7/17/2007 3:04:56 PM,0,0x,Beginning of package execution.

OnError,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073659899,0x,The connection type "FLATFILE" specified for connection manager "MembersWithUpdates" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

OnError,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073659899,0x,The connection type "FLATFILE" specified for connection manager "MembersWithUpdates" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

OnError,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073676264,0x,Error loading value "<DTS:ConnectionManager xmlns:DTS="www.microsoft.com/SqlServer/Dts"><DTS:Property DTS:Name="DelayValidation">-1</DTS:Property><DTS:Property DTS:Name="ObjectName">MembersWithUpdates</DTS:Property><DTS:Property DTS:Name="DTSID">{D6867FEB-27D8-4576-80CB-A53449" from node "DTS:ConnectionManager".

OnError,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073676264,0x,Error loading value "<DTS:ConnectionManager xmlns:DTS="www.microsoft.com/SqlServer/Dts"><DTS:Property DTS:Name="DelayValidation">-1</DTS:Property><DTS:Property DTS:Name="ObjectName">MembersWithUpdates</DTS:Property><DTS:Property DTS:Name="DTSID">{D6867FEB-27D8-4576-80CB-A53449" from node "DTS:ConnectionManager".

OnError,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073602338,0x,Error 0xC0010014 while loading package file "C:\SSIS\DasLoader\Member.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.
.

OnError,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073602338,0x,Error 0xC0010014 while loading package file "C:\SSIS\DasLoader\Member.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.
.

OnTaskFailed,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,0,0x,(null)
PackageStart,MyComputerNameG,DomanName\MyUserAccount,BenefitPlan,{48289F86-1429-44B0-B5F7-295F31B6F39E},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:22 PM,7/17/2007 3:05:22 PM,0,0x,Beginning of package execution.

PackageStart,MyComputerNameG,DomanName\MyUserAccount,CustomInformationCodeLookup,{C4C5D8F8-CD26-4C94-ADB4-D40607F67D70},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:29 PM,7/17/2007 3:05:29 PM,0,0x,Beginning of package execution.

PackageStart,MyComputerNameG,DomanName\MyUserAccount,Provider,{6F1B4233-8A08-4688-827F-FB98DC7F975F},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:30 PM,7/17/2007 3:05:30 PM,0,0x,Beginning of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,CustomInformationCodeLookup,{C4C5D8F8-CD26-4C94-ADB4-D40607F67D70},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:31 PM,7/17/2007 3:05:31 PM,0,0x,End of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,BenefitPlan,{48289F86-1429-44B0-B5F7-295F31B6F39E},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:36 PM,7/17/2007 3:05:36 PM,0,0x,End of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,Provider,{6F1B4233-8A08-4688-827F-FB98DC7F975F},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:47 PM,7/17/2007 3:05:47 PM,0,0x,End of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:47 PM,7/17/2007 3:05:47 PM,0,0x,End of package execution.

|||

Hi Steve,

Just came across this page in Microsoft support site. See if this helps you.

http://support.microsoft.com/kb/913817/en-us

Regards

Saurabh

|||

Saurabh Kulkarni wrote:

Hi Steve,

Just came across this page in Microsoft support site. See if this helps you.

http://support.microsoft.com/kb/913817/en-us

Regards

Saurabh

He's followed the steps in that KB article already and no "bad" registry keys were identified.

|||[Microsoft follow-up]
again.

Come on guys.|||

something looks funny with this text from the error message:

Error loading value "-1Load Ready Output Connection Manager{3A5E4ACC-9BF" from node

almost as if the xml parsing has gone bad. the guid is chopped off and the string starts with -1.

do you have any objects with odd characters in the names. characters that could mess up a parser like < > " , - etc. ?

|||

Thanks for Microsoft's help coming out...

No, I checked packages and do not have/see any objects that contains weird name etc. Please take a look at my longer posting above.

The observation is that all of packages run successfully sometimes, while failed on the other times. It is not stable. I repeatedly re-run my packages above yesterday without any failure. But today it starts to fail occasionally.

If the packages contains object names with special characters, the packages should always fail.

I would be very willing to send you via email the four small and simple packages.

Steve

Package execution stability ?

I am running into some issue that i have found any good clue on this forum... although have seen a few threads dicussions. I have a master package which invokes a dozen of child packages.

1) If I only open master package inside IDE, I am keeping getting the following error when i run the master packages inside Visual Studio 2005 IDE.

The connection type "FLATFILE" specified for connection manager "XXXXX Flat File Destination Connection Manager" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name

2) If I opened up all child packages inside IDE, the master package run fine most of time.

Any suggestions?

Are you using a connection type of "flat file" or just the "file" connection manager type?|||

See below please

|||

It is a flat file type: Here is the error details:

Code Snippet

Error: 0xC0014005 at : The connection type "FLATFILE" specified for connection manager "Load Ready Output Connection Manager" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

Error: 0xC0010018 at : Error loading value "-1Load Ready Output Connection Manager{3A5E4ACC-9BF" from node "DTS:ConnectionManager".

Error: 0xC00220DE at Process Provider Data: Error 0xC0010014 while loading package file "C:\SSIS\newDas\Provider.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.

But I also get this Error in the same time.

Code Snippet

Error: 0xC0014005 at : The connection type "OLEDB" specified for connection manager "Target Database Connection" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

Error: 0xC0010018 at : Error loading value "-1Target Database Connection{CBD29A65-2BBC-4BB6-AED" from node "DTS:ConnectionManager".

Error: 0xC00220DE at Process BenefitPlan Data: Error 0xC0010014 while loading package file "C:\SSIS\newDas\BenefitPlan.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.

SO IT SEEMS THAT THE CONNECTION TYPE IS NOT RECOGNIZED FOR SOME WEIRD REASONS BEHIND....

Help..........

|||

Try to look at this thread and see if the answer solves your problem:

http://forums.microsoft.com/MSDN/ShowPost.aspx?PageIndex=4&SiteID=1&PostID=363238&PageID=1

Thanks,

Ovidiu Burlacu

|||

Thanks. Unfortunately, the link did NOT fix my problem.

I followed Mike's suggestion by creating the application and a non-administrative account. I did not see any incorrect registry key dosplayed. Help !!!

|||What version of SSIS do you have? RTM? SP1? SP2?

Seems like something is corrupt. Any changes to the system recently?|||

I have tried packages on various machines (RTM on Windows 2003, SP2 on Windows xp Pro ) and the error is repeatable on any machines.

Here is the version info for SSIS from "About" on Visual Studio 2005.

Microsoft SQL Server Integration Services Designer Version 9.00.3042.00

|||Microsoft follow-up:

I can create a simple package (OLE DB Source -> Flat File Destination) and recreate this error by opening the resulting .dtsx file in my favorite text editor. When doing so, searching by CaSE and replacing "FLATFILE" with "FLATFILE2" yields the same error message as Steve has indicated. Obviously, FLATFILE2 is not a valid connection manager type. So, with that said, where is the validation occurring to determine if the connection manager type is valid or not? And what can Steve do about it?|||

Thanks Phil for attention.

Here is complete info from package log in attempt to get help here. Any help will be greatly appreciated.

Code Snippet

#Fields: event,computer,operator,source,sourceid,executionid,starttime,endtime,datacode,databytes,message
PackageStart,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:04:56 PM,7/17/2007 3:04:56 PM,0,0x,Beginning of package execution.

OnError,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073659899,0x,The connection type "FLATFILE" specified for connection manager "MembersWithUpdates" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

OnError,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073659899,0x,The connection type "FLATFILE" specified for connection manager "MembersWithUpdates" is not recognized as a valid connection manager type. This error is returned when an attempt is made to create a connection manager for an unknown connection type. Check the spelling in the connection type name.

OnError,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073676264,0x,Error loading value "<DTS:ConnectionManager xmlns:DTS="www.microsoft.com/SqlServer/Dts"><DTS:Property DTS:Name="DelayValidation">-1</DTS:Property><DTS:Property DTS:Name="ObjectName">MembersWithUpdates</DTS:Property><DTS:Property DTS:Name="DTSID">{D6867FEB-27D8-4576-80CB-A53449" from node "DTS:ConnectionManager".

OnError,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073676264,0x,Error loading value "<DTS:ConnectionManager xmlns:DTS="www.microsoft.com/SqlServer/Dts"><DTS:Property DTS:Name="DelayValidation">-1</DTS:Property><DTS:Property DTS:Name="ObjectName">MembersWithUpdates</DTS:Property><DTS:Property DTS:Name="DTSID">{D6867FEB-27D8-4576-80CB-A53449" from node "DTS:ConnectionManager".

OnError,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073602338,0x,Error 0xC0010014 while loading package file "C:\SSIS\DasLoader\Member.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.
.

OnError,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,-1073602338,0x,Error 0xC0010014 while loading package file "C:\SSIS\DasLoader\Member.dtsx". One or more error occurred. There should be more specific errors preceding this one that explains the details of the errors. This message is used as a return value from functions that encounter errors.
.

OnTaskFailed,MyComputerNameG,DomanName\MyUserAccount,Process Member Data,{874B05D3-3ED9-453A-BEF5-2595710C0B04},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:17 PM,7/17/2007 3:05:17 PM,0,0x,(null)
PackageStart,MyComputerNameG,DomanName\MyUserAccount,BenefitPlan,{48289F86-1429-44B0-B5F7-295F31B6F39E},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:22 PM,7/17/2007 3:05:22 PM,0,0x,Beginning of package execution.

PackageStart,MyComputerNameG,DomanName\MyUserAccount,CustomInformationCodeLookup,{C4C5D8F8-CD26-4C94-ADB4-D40607F67D70},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:29 PM,7/17/2007 3:05:29 PM,0,0x,Beginning of package execution.

PackageStart,MyComputerNameG,DomanName\MyUserAccount,Provider,{6F1B4233-8A08-4688-827F-FB98DC7F975F},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:30 PM,7/17/2007 3:05:30 PM,0,0x,Beginning of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,CustomInformationCodeLookup,{C4C5D8F8-CD26-4C94-ADB4-D40607F67D70},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:31 PM,7/17/2007 3:05:31 PM,0,0x,End of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,BenefitPlan,{48289F86-1429-44B0-B5F7-295F31B6F39E},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:36 PM,7/17/2007 3:05:36 PM,0,0x,End of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,Provider,{6F1B4233-8A08-4688-827F-FB98DC7F975F},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:47 PM,7/17/2007 3:05:47 PM,0,0x,End of package execution.

PackageEnd,MyComputerNameG,DomanName\MyUserAccount,OMXLoadTransformSequencer,{FC99AFBF-316F-458B-B989-30EC8DC97A45},{83B517B1-622A-4015-A99E-64944A225E09},7/17/2007 3:05:47 PM,7/17/2007 3:05:47 PM,0,0x,End of package execution.

|||

Hi Steve,

Just came across this page in Microsoft support site. See if this helps you.

http://support.microsoft.com/kb/913817/en-us

Regards

Saurabh

|||

Saurabh Kulkarni wrote:

Hi Steve,

Just came across this page in Microsoft support site. See if this helps you.

http://support.microsoft.com/kb/913817/en-us

Regards

Saurabh

He's followed the steps in that KB article already and no "bad" registry keys were identified.

|||[Microsoft follow-up]
again.

Come on guys.|||

something looks funny with this text from the error message:

Error loading value "-1Load Ready Output Connection Manager{3A5E4ACC-9BF" from node

almost as if the xml parsing has gone bad. the guid is chopped off and the string starts with -1.

do you have any objects with odd characters in the names. characters that could mess up a parser like < > " , - etc. ?

|||

Thanks for Microsoft's help coming out...

No, I checked packages and do not have/see any objects that contains weird name etc. Please take a look at my longer posting above.

The observation is that all of packages run successfully sometimes, while failed on the other times. It is not stable. I repeatedly re-run my packages above yesterday without any failure. But today it starts to fail occasionally.

If the packages contains object names with special characters, the packages should always fail.

I would be very willing to send you via email the four small and simple packages.

Steve

Monday, February 20, 2012

Overcoming orphans

How do you restore master to a new database and not orphan users in the
process?
Message posted via http://www.droptable.com
Look up sp_change_users_login in BOL.
Geoff N. Hiten
Senior Database Administrator
Microsoft SQL Server MVP
"Robert R via droptable.com" <u3288@.uwe> wrote in message
news:5d589125f94ca@.uwe...
> How do you restore master to a new database and not orphan users in the
> process?
> --
> Message posted via http://www.droptable.com

Overcoming orphans

How do you restore master to a new database and not orphan users in the
process?
Message posted via http://www.droptable.comLook up sp_change_users_login in BOL.
Geoff N. Hiten
Senior Database Administrator
Microsoft SQL Server MVP
"Robert R via droptable.com" <u3288@.uwe> wrote in message
news:5d589125f94ca@.uwe...
> How do you restore master to a new database and not orphan users in the
> process?
> --
> Message posted via http://www.droptable.com

Overcoming orphans

How do you restore master to a new database and not orphan users in the
process?
--
Message posted via http://www.sqlmonster.comLook up sp_change_users_login in BOL.
--
Geoff N. Hiten
Senior Database Administrator
Microsoft SQL Server MVP
"Robert R via SQLMonster.com" <u3288@.uwe> wrote in message
news:5d589125f94ca@.uwe...
> How do you restore master to a new database and not orphan users in the
> process?
> --
> Message posted via http://www.sqlmonster.com