Friday, March 30, 2012
Page allocationError
There a quite strange error i am getting :
"Could not allocate new page for database 'rough'. There are no more pages available in filegroup PRIMARY. Space can be created by dropping objects, adding additional files, or allowing file growth."
This database has unrestricted filegrowth, the current size of the datafile is 4.6GB and there is 9 GB space free on the hard disk.
The recovery model is full logged.
sql server 2k with sp3a.
any thoughts?
harshal.Run SP_SPACEUSED & SP_HELPDB for information on this database.|||Run SP_SPACEUSED & SP_HELPDB for information on this database.
what exactly should i be looking for?
It shows 4081.94 MB space used. And unallocated space is shown negative i.e. -9.74 MB.|||CHeck what is the space left on PRIMARY FILEGROUP.
Run SP_HELPFILE and use DBCC UPDATEUSAGE before running.|||Hi satya,
thanks for the reply.
after running dbcc updateusage, it updated the usage.
after running sp_helpfile it shows for primary filegroup size=4116480 KB
Max=5121024 KB
Growth=10%
when i try to increase the size of the primary datafile it again gives the same error.
thanks
harshal.|||Have you disabled auto grow on the primary filegroup?
Ensure there are no disk space issues where Primary filegroup is hosted.|||Have you disabled auto grow on the primary filegroup?
Ensure there are no disk space issues where Primary filegroup is hosted.
That is the whole problem auto grow is enabled and there is ample space on the drive where primary filegroup is hosted, still it is not allocating the space.|||See what happens when you manually expand the file by say 100 MB. You may be running into a timing conflict of some kind, with the growth set to 10%. At this point, the file will try to grow by almost half a gig. This will take some time. I would consider setting the filegrowth to a flat value. Probably 10 - 50 MB, depending on the growth rate of the database.|||See what happens when you manually expand the file by say 100 MB. You may be running into a timing conflict of some kind, with the growth set to 10%. At this point, the file will try to grow by almost half a gig. This will take some time. I would consider setting the filegrowth to a flat value. Probably 10 - 50 MB, depending on the growth rate of the database.
Ok I tried increasing the size of the database in units of 50 MB, it worked fine the first time when the size was 4095MB but after that if i try to increase it more even by 1 MB it gives me the same error.
What can possibly be the reason? can there be some kind of quota or some thing which may be configured?|||How much available disk space do you have on that drive?|||How much available disk space do you have on that drive?
free space on the drive is 9.04 GB.|||Hmm. Maybe there is an O/S limit on files? Never heard of such a thing, though. But, just to test out if it is the O/S playing with your head, try backing up the database a couple times to the same file. You should be able to create a file greater than 4GB in size. What O/S is this? 2K or 2K3?|||ok i'll try that.
its 2k server|||ok i'll try that.
But only on MONDAY :D
Time to call it a week !!! :rolleyes:|||Hmm. Maybe there is an O/S limit on files? Never heard of such a thing, though. But, just to test out if it is the O/S playing with your head, try backing up the database a couple times to the same file. You should be able to create a file greater than 4GB in size. What O/S is this? 2K or 2K3?Don't even go there! The SQL Server limits (http://msdn.microsoft.com/library/en-us/architec/8_ar_ts_8dbn.asp) aren't an issue here!
-PatP|||Don't even go there! The SQL Server limits (http://msdn.microsoft.com/library/en-us/architec/8_ar_ts_8dbn.asp) aren't an issue here!
-PatP
yeah thats right but then what is causing this?|||ok here is the error again:
"Error 5149: MODIFY FILE encountered operating system error 112(There is not enough space on the disk.) while attempting to expand the physical file."
it says that it is operating system error.
As if the os is not able to "SEE" the existing empty space.|||Harshal ... Yes ... Now that Mcrowley mentions it .. i remember reading about it somewhere...
I will bet a bottle of whiskey on your file system being FAT32. FAT32 file systems have a 4 GB file size limit ... you will need to convert your file system to NTFS in case you want a db file bigger than 4 GB.
Do tell if I am right ...|||http://support.microsoft.com/default.aspx?scid=kb;en-us;314463
Enigma: Looks like you are on to something there.|||http://www.microsoft.com/resources/documentation/Windows/XP/all/reskit/en-us/Default.asp?url=/resources/documentation/windows/xp/all/reskit/en-us/prkc_fil_tdrn.asp
take a look at this too|||http://sqljunkies.com/WebLog/enigma/archive/2004/05/14/2483.aspx|||Harshal ... Yes ... Now that Mcrowley mentions it .. i remember reading about it somewhere...
I will bet a bottle of whiskey on your file system being FAT32. FAT32 file systems have a 4 GB file size limit ... you will need to convert your file system to NTFS in case you want a db file bigger than 4 GB.
Do tell if I am right ...
Hey Enigma I owe you a Grand Single Malt on this.
Just now converted the file system to NTFS it was indeed fat32 and Bingooo !!|||Was this your prod system ?|||Was this your prod system ?
No Way!!
It is my personal workstation.|||Great zot man!
I'm certainly glad that you found your solution. I'm also deathly curious as to why on earth you'd run FAT32 on an NT workstation ?!?! We used to run FAT32 and/or unformatted volumes in the days of Win-NT 3.51, but the thought that you might be running FAT today never entered my mind!
-PatP|||Great zot man!
I'm certainly glad that you found your solution. I'm also deathly curious as to why on earth you'd run FAT32 on an NT workstation ?!?! We used to run FAT32 and/or unformatted volumes in the days of Win-NT 3.51, but the thought that you might be running FAT today never entered my mind!
-PatP
:D :D ;)
Actually a couple of weeks back my secondary hard disk had crashed and so the network admin gave me a spare disk, said that this is a temperory arrangement he would be giving me a new disk soon, but i never got that disk and i continued with what i had and never checked what the file system was.
:(
Page allocation error
There a quite strange error i am getting :
"Could not allocate new page for database 'rough'. There are no more pages
available in filegroup PRIMARY. Space can be created by dropping objects,
adding additional files, or allowing file growth."
This database has unrestricted filegrowth, the current size of the datafile
is 4.6GB and there is 9 GB space free on the hard disk.
The recovery model is full logged.
sql server 2k with sp3a.
any thoughts?
harshal.
Sometimes autogrow doesn't catch up with the space requirements, resulting in this error message. I suggest
you pre-allocate storage.
Tibor Karaszi, SQL Server MVP
http://www.karaszi.com/sqlserver/default.asp
"harshal mistry" <harshal_in@.hotmail.com> wrote in message news:u3yRBFLOEHA.2716@.tk2msftngp13.phx.gbl...
> Hi all,
> There a quite strange error i am getting :
> "Could not allocate new page for database 'rough'. There are no more pages
> available in filegroup PRIMARY. Space can be created by dropping objects,
> adding additional files, or allowing file growth."
> This database has unrestricted filegrowth, the current size of the datafile
> is 4.6GB and there is 9 GB space free on the hard disk.
> The recovery model is full logged.
> sql server 2k with sp3a.
> any thoughts?
> harshal.
>
|||yeah for the same reason i tried to increase the size of the file from the
enterprise manager it still gave me the same error.
"Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote in
message news:uGe3zrNOEHA.904@.TK2MSFTNGP12.phx.gbl...
> Sometimes autogrow doesn't catch up with the space requirements, resulting
in this error message. I suggest
> you pre-allocate storage.
> --
> Tibor Karaszi, SQL Server MVP
> http://www.karaszi.com/sqlserver/default.asp
>
> "harshal mistry" <harshal_in@.hotmail.com> wrote in message
news:u3yRBFLOEHA.2716@.tk2msftngp13.phx.gbl...[vbcol=seagreen]
pages[vbcol=seagreen]
objects,[vbcol=seagreen]
datafile
>
|||Seems to be a problem at the OS level, if SQL Server cannot allocate space even though space exists on the
hard drive. A couple of things to check is if you have disk quotas or compression.
Tibor Karaszi, SQL Server MVP
http://www.karaszi.com/sqlserver/default.asp
"harshal mistry" <harshal_in@.hotmail.com> wrote in message news:eXi1eLOOEHA.3016@.tk2msftngp13.phx.gbl...
> yeah for the same reason i tried to increase the size of the file from the
> enterprise manager it still gave me the same error.
> "Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote in
> message news:uGe3zrNOEHA.904@.TK2MSFTNGP12.phx.gbl...
> in this error message. I suggest
> news:u3yRBFLOEHA.2716@.tk2msftngp13.phx.gbl...
> pages
> objects,
> datafile
>
|||no there is no compression done on the disk and the funny thing is that if i
delete some thing on the disk then it allows me to allocate the space for
that database, but even if i dont delete anything and try to increase the
space on other database there is no problem.
what else do i be looking for?
Thanks and Regards,
Harshal.
"Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote in
message news:ujLfGjOOEHA.3752@.TK2MSFTNGP12.phx.gbl...
> Seems to be a problem at the OS level, if SQL Server cannot allocate space
even though space exists on the
> hard drive. A couple of things to check is if you have disk quotas or
compression.
> --
> Tibor Karaszi, SQL Server MVP
> http://www.karaszi.com/sqlserver/default.asp
>
> "harshal mistry" <harshal_in@.hotmail.com> wrote in message
news:eXi1eLOOEHA.3016@.tk2msftngp13.phx.gbl...[vbcol=seagreen]
the[vbcol=seagreen]
in[vbcol=seagreen]
resulting
>
Page allocation error
There a quite strange error i am getting :
"Could not allocate new page for database 'rough'. There are no more pages
available in filegroup PRIMARY. Space can be created by dropping objects,
adding additional files, or allowing file growth."
This database has unrestricted filegrowth, the current size of the datafile
is 4.6GB and there is 9 GB space free on the hard disk.
The recovery model is full logged.
sql server 2k with sp3a.
any thoughts?
harshal.Sometimes autogrow doesn't catch up with the space requirements, resulting i
n this error message. I suggest
you pre-allocate storage.
Tibor Karaszi, SQL Server MVP
http://www.karaszi.com/sqlserver/default.asp
"harshal mistry" <harshal_in@.hotmail.com> wrote in message news:u3yRBFLOEHA.2716@.tk2msftngp1
3.phx.gbl...
> Hi all,
> There a quite strange error i am getting :
> "Could not allocate new page for database 'rough'. There are no more pages
> available in filegroup PRIMARY. Space can be created by dropping objects,
> adding additional files, or allowing file growth."
> This database has unrestricted filegrowth, the current size of the datafil
e
> is 4.6GB and there is 9 GB space free on the hard disk.
> The recovery model is full logged.
> sql server 2k with sp3a.
> any thoughts?
> harshal.
>|||yeah for the same reason i tried to increase the size of the file from the
enterprise manager it still gave me the same error.
"Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote in
message news:uGe3zrNOEHA.904@.TK2MSFTNGP12.phx.gbl...
> Sometimes autogrow doesn't catch up with the space requirements, resulting
in this error message. I suggest
> you pre-allocate storage.
> --
> Tibor Karaszi, SQL Server MVP
> http://www.karaszi.com/sqlserver/default.asp
>
> "harshal mistry" <harshal_in@.hotmail.com> wrote in message
news:u3yRBFLOEHA.2716@.tk2msftngp13.phx.gbl...
pages[vbcol=seagreen]
objects,[vbcol=seagreen]
datafile[vbcol=seagreen]
>|||Seems to be a problem at the OS level, if SQL Server cannot allocate space e
ven though space exists on the
hard drive. A couple of things to check is if you have disk quotas or compre
ssion.
Tibor Karaszi, SQL Server MVP
http://www.karaszi.com/sqlserver/default.asp
"harshal mistry" <harshal_in@.hotmail.com> wrote in message news:eXi1eLOOEHA.3016@.tk2msftngp1
3.phx.gbl...
> yeah for the same reason i tried to increase the size of the file from the
> enterprise manager it still gave me the same error.
> "Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote i
n
> message news:uGe3zrNOEHA.904@.TK2MSFTNGP12.phx.gbl...
> in this error message. I suggest
> news:u3yRBFLOEHA.2716@.tk2msftngp13.phx.gbl...
> pages
> objects,
> datafile
>|||no there is no compression done on the disk and the funny thing is that if i
delete some thing on the disk then it allows me to allocate the space for
that database, but even if i dont delete anything and try to increase the
space on other database there is no problem.
what else do i be looking for?
Thanks and Regards,
Harshal.
"Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote in
message news:ujLfGjOOEHA.3752@.TK2MSFTNGP12.phx.gbl...
> Seems to be a problem at the OS level, if SQL Server cannot allocate space
even though space exists on the
> hard drive. A couple of things to check is if you have disk quotas or
compression.
> --
> Tibor Karaszi, SQL Server MVP
> http://www.karaszi.com/sqlserver/default.asp
>
> "harshal mistry" <harshal_in@.hotmail.com> wrote in message
news:eXi1eLOOEHA.3016@.tk2msftngp13.phx.gbl...
the[vbcol=seagreen]
in[vbcol=seagreen]
resulting[vbcol=seagreen]
>
Page allocation error
There a quite strange error i am getting :
"Could not allocate new page for database 'rough'. There are no more pages
available in filegroup PRIMARY. Space can be created by dropping objects,
adding additional files, or allowing file growth."
This database has unrestricted filegrowth, the current size of the datafile
is 4.6GB and there is 9 GB space free on the hard disk.
The recovery model is full logged.
sql server 2k with sp3a.
any thoughts?
harshal.Sometimes autogrow doesn't catch up with the space requirements, resulting in this error message. I suggest
you pre-allocate storage.
--
Tibor Karaszi, SQL Server MVP
http://www.karaszi.com/sqlserver/default.asp
"harshal mistry" <harshal_in@.hotmail.com> wrote in message news:u3yRBFLOEHA.2716@.tk2msftngp13.phx.gbl...
> Hi all,
> There a quite strange error i am getting :
> "Could not allocate new page for database 'rough'. There are no more pages
> available in filegroup PRIMARY. Space can be created by dropping objects,
> adding additional files, or allowing file growth."
> This database has unrestricted filegrowth, the current size of the datafile
> is 4.6GB and there is 9 GB space free on the hard disk.
> The recovery model is full logged.
> sql server 2k with sp3a.
> any thoughts?
> harshal.
>|||yeah for the same reason i tried to increase the size of the file from the
enterprise manager it still gave me the same error.
"Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote in
message news:uGe3zrNOEHA.904@.TK2MSFTNGP12.phx.gbl...
> Sometimes autogrow doesn't catch up with the space requirements, resulting
in this error message. I suggest
> you pre-allocate storage.
> --
> Tibor Karaszi, SQL Server MVP
> http://www.karaszi.com/sqlserver/default.asp
>
> "harshal mistry" <harshal_in@.hotmail.com> wrote in message
news:u3yRBFLOEHA.2716@.tk2msftngp13.phx.gbl...
> > Hi all,
> > There a quite strange error i am getting :
> > "Could not allocate new page for database 'rough'. There are no more
pages
> > available in filegroup PRIMARY. Space can be created by dropping
objects,
> > adding additional files, or allowing file growth."
> >
> > This database has unrestricted filegrowth, the current size of the
datafile
> > is 4.6GB and there is 9 GB space free on the hard disk.
> >
> > The recovery model is full logged.
> > sql server 2k with sp3a.
> >
> > any thoughts?
> >
> > harshal.
> >
> >
>|||Seems to be a problem at the OS level, if SQL Server cannot allocate space even though space exists on the
hard drive. A couple of things to check is if you have disk quotas or compression.
--
Tibor Karaszi, SQL Server MVP
http://www.karaszi.com/sqlserver/default.asp
"harshal mistry" <harshal_in@.hotmail.com> wrote in message news:eXi1eLOOEHA.3016@.tk2msftngp13.phx.gbl...
> yeah for the same reason i tried to increase the size of the file from the
> enterprise manager it still gave me the same error.
> "Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote in
> message news:uGe3zrNOEHA.904@.TK2MSFTNGP12.phx.gbl...
> > Sometimes autogrow doesn't catch up with the space requirements, resulting
> in this error message. I suggest
> > you pre-allocate storage.
> >
> > --
> > Tibor Karaszi, SQL Server MVP
> > http://www.karaszi.com/sqlserver/default.asp
> >
> >
> > "harshal mistry" <harshal_in@.hotmail.com> wrote in message
> news:u3yRBFLOEHA.2716@.tk2msftngp13.phx.gbl...
> > > Hi all,
> > > There a quite strange error i am getting :
> > > "Could not allocate new page for database 'rough'. There are no more
> pages
> > > available in filegroup PRIMARY. Space can be created by dropping
> objects,
> > > adding additional files, or allowing file growth."
> > >
> > > This database has unrestricted filegrowth, the current size of the
> datafile
> > > is 4.6GB and there is 9 GB space free on the hard disk.
> > >
> > > The recovery model is full logged.
> > > sql server 2k with sp3a.
> > >
> > > any thoughts?
> > >
> > > harshal.
> > >
> > >
> >
> >
>|||no there is no compression done on the disk and the funny thing is that if i
delete some thing on the disk then it allows me to allocate the space for
that database, but even if i dont delete anything and try to increase the
space on other database there is no problem.
what else do i be looking for?
Thanks and Regards,
Harshal.
"Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote in
message news:ujLfGjOOEHA.3752@.TK2MSFTNGP12.phx.gbl...
> Seems to be a problem at the OS level, if SQL Server cannot allocate space
even though space exists on the
> hard drive. A couple of things to check is if you have disk quotas or
compression.
> --
> Tibor Karaszi, SQL Server MVP
> http://www.karaszi.com/sqlserver/default.asp
>
> "harshal mistry" <harshal_in@.hotmail.com> wrote in message
news:eXi1eLOOEHA.3016@.tk2msftngp13.phx.gbl...
> > yeah for the same reason i tried to increase the size of the file from
the
> > enterprise manager it still gave me the same error.
> >
> > "Tibor Karaszi" <tibor_please.no.email_karaszi@.hotmail.nomail.com> wrote
in
> > message news:uGe3zrNOEHA.904@.TK2MSFTNGP12.phx.gbl...
> > > Sometimes autogrow doesn't catch up with the space requirements,
resulting
> > in this error message. I suggest
> > > you pre-allocate storage.
> > >
> > > --
> > > Tibor Karaszi, SQL Server MVP
> > > http://www.karaszi.com/sqlserver/default.asp
> > >
> > >
> > > "harshal mistry" <harshal_in@.hotmail.com> wrote in message
> > news:u3yRBFLOEHA.2716@.tk2msftngp13.phx.gbl...
> > > > Hi all,
> > > > There a quite strange error i am getting :
> > > > "Could not allocate new page for database 'rough'. There are no more
> > pages
> > > > available in filegroup PRIMARY. Space can be created by dropping
> > objects,
> > > > adding additional files, or allowing file growth."
> > > >
> > > > This database has unrestricted filegrowth, the current size of the
> > datafile
> > > > is 4.6GB and there is 9 GB space free on the hard disk.
> > > >
> > > > The recovery model is full logged.
> > > > sql server 2k with sp3a.
> > > >
> > > > any thoughts?
> > > >
> > > > harshal.
> > > >
> > > >
> > >
> > >
> >
> >
>
Page (1:368132)
Can i know the DBID with this reference Page (1:368132)'
I'm getting this error
EventID: 0x4000429C (17052) - Error: 7105, Severity: 22,
State: 6
Page (1:370082), slot 5 for text, ntext, or image node
does not exist.
Can anyone help '
Thanks in advance
Celso CorreiaUnfortunately, no. Please look at the errorlog and see if there are any
other related error messages that may tell you which database has this
problem.
This error could be caused by a database page corruption. So please run dbcc
checktable after you have determined which database/table has the issue.
Based on the page id, the database file could be quite large: about 2.9GB.
This might help.
--
Wei Xiao [MSFT]
SQL Server Storage Engine Development
This posting is provided "AS IS" with no warranties, and confers no rights.
"Miguel" <anonymous@.discussions.microsoft.com> wrote in message
news:070a01c494ca$d8f165a0$a401280a@.phx.gbl...
> Hi,
> Can i know the DBID with this reference Page (1:368132)'
> I'm getting this error
> EventID: 0x4000429C (17052) - Error: 7105, Severity: 22,
> State: 6
> Page (1:370082), slot 5 for text, ntext, or image node
> does not exist.
> Can anyone help '
> Thanks in advance
> Celso Correia
>
Page (1:368132)
Can i know the DBID with this reference Page (1:368132)?
I'm getting this error
EventID: 0x4000429C (17052) - Error: 7105, Severity: 22,
State: 6
Page (1:370082), slot 5 for text, ntext, or image node
does not exist.
Can anyone help ?
Thanks in advance
Celso Correia
Unfortunately, no. Please look at the errorlog and see if there are any
other related error messages that may tell you which database has this
problem.
This error could be caused by a database page corruption. So please run dbcc
checktable after you have determined which database/table has the issue.
Based on the page id, the database file could be quite large: about 2.9GB.
This might help.
Wei Xiao [MSFT]
SQL Server Storage Engine Development
This posting is provided "AS IS" with no warranties, and confers no rights.
"Miguel" <anonymous@.discussions.microsoft.com> wrote in message
news:070a01c494ca$d8f165a0$a401280a@.phx.gbl...
> Hi,
> Can i know the DBID with this reference Page (1:368132)?
> I'm getting this error
> EventID: 0x4000429C (17052) - Error: 7105, Severity: 22,
> State: 6
> Page (1:370082), slot 5 for text, ntext, or image node
> does not exist.
> Can anyone help ?
> Thanks in advance
> Celso Correia
>
Wednesday, March 28, 2012
PacketSize
"General network error. Check your network documentation."
It occurrs when I write/update to MSDE 2000 using ADO.NET's SqlClient classe
s. It only occurrs when the record reaches a certain size (around 10K, or s
o) and only occurs in certain environments. Some XP and some Windows 2000 e
nvironments are OK, while o
thers give the error.
I am aware of the PacketSize property in the SqlConnection class, but as of
yet have not set it and have just relied on the default value.
I feel there is something in the .NET or the ADO providers' environment or c
onfigurations that I am not aware of, and would appreciate any help in this
regard.Perhaps try turning off connection pooling (229564)
Bern
"Paul Wicks" <paulwicks@.htninc.com> wrote in message
news:6BAB551B-AC85-4D1C-8B41-89A79A719C81@.microsoft.com...
> I am getting the error:
> "General network error. Check your network documentation."
> It occurrs when I write/update to MSDE 2000 using ADO.NET's SqlClient
classes. It only occurrs when the record reaches a certain size (around
10K, or so) and only occurs in certain environments. Some XP and some
Windows 2000 environments are OK, while others give the error.
> I am aware of the PacketSize property in the SqlConnection class, but as
of yet have not set it and have just relied on the default value.
> I feel there is something in the .NET or the ADO providers' environment or
configurations that I am not aware of, and would appreciate any help in this
regard.
>|||Thanks for your suggestion, Bern.
I wish I could report good news, but the disabling of SQL Server connection
pooling had no effect.
I think I will leave it disabled to avoid possible future complications.
PacketSize
"General network error. Check your network documentation."
It occurrs when I write/update to MSDE 2000 using ADO.NET's SqlClient classes. It only occurrs when the record reaches a certain size (around 10K, or so) and only occurs in certain environments. Some XP and some Windows 2000 environments are OK, while o
thers give the error.
I am aware of the PacketSize property in the SqlConnection class, but as of yet have not set it and have just relied on the default value.
I feel there is something in the .NET or the ADO providers' environment or configurations that I am not aware of, and would appreciate any help in this regard.
Perhaps try turning off connection pooling (229564)
Bern
"Paul Wicks" <paulwicks@.htninc.com> wrote in message
news:6BAB551B-AC85-4D1C-8B41-89A79A719C81@.microsoft.com...
> I am getting the error:
> "General network error. Check your network documentation."
> It occurrs when I write/update to MSDE 2000 using ADO.NET's SqlClient
classes. It only occurrs when the record reaches a certain size (around
10K, or so) and only occurs in certain environments. Some XP and some
Windows 2000 environments are OK, while others give the error.
> I am aware of the PacketSize property in the SqlConnection class, but as
of yet have not set it and have just relied on the default value.
> I feel there is something in the .NET or the ADO providers' environment or
configurations that I am not aware of, and would appreciate any help in this
regard.
>
|||Thanks for your suggestion, Bern.
I wish I could report good news, but the disabling of SQL Server connection pooling had no effect.
I think I will leave it disabled to avoid possible future complications.
Monday, March 26, 2012
Packages error or hang in SQL Agent but not in BI IDE
Hi ,
I have an issues that worries me alot. I have SSIS packages scheduled in SQL Agent and they sometime error out or hang in Agent but never when i run them in BI IDE (Visual studio). There are two particular packages that always hang, alway in Agent but when i run them in BI IDE, they run just fine. Im was running them under in Agent under type= Sql server intergration services and also tried running under type = Operating System (CmdExec). Both types have the same problem. The packages hang. The log files dont say much, because the packages hang, no logging is doing so i dont get any infomation to determin what is going on. Can someone please help me ou.
Can you provide more information about the package:
What security settings are you using?
What tasks are in the package?
Where is the package hanging?
What log events do you have enabled?
Is it consistent? Happens everytime?
Does it happen if you run it under DTExec in the same credentials as under Agent?
Kirk Haselden
Author "SQL Server Integration Services"
The task contained the the package are two data flow componenet ( in which there is a download from a remote source to local sql sever destination server ) , two execute sql task from which a sql statement is set to a varaible and assigned to the sql property of the datasources (using expression) in the data flow componenets and lastly , email task to send emails if the packaged failed or passed.
I have all the log even enable except for those in relation to the pipelines like OnPipelinePostEndOfRowset
It hangs everytime the packages runs in Sql Agent but not in VS (BI IDE)
I have only run it with dtexec under Agent and its still hangs.|||
This won't work because EncryptSensitiveWithUserKey uses the credentials of the user on the machine where the package is built.
Change the package protection level to "Rely on server storage for encryption".
Save the package to SQL Server and then schedule the package to run in Agent.
Should fix the issue.
Kirk Haselden
Author "SQL Server Integration Services"
Have you actually tried doing this on SQL Server 2005 SP1? BIDS will not let you save a package with 'Server Storage' ProtectionLevel. Therefore, I can't build a deployment manifest where I get the 'Rely on server storage for encryption' option. Just what do you mean by 'save the package to SQL Server'? I'm assuming that's using a deployment manifest file which opens the deployment wizard, is there a better way?
|||this link describes how to save a package to sql server: http://msdn2.microsoft.com/en-us/library/ms137565.aspxDawnJ wrote:
Just what do you mean by 'save the package to SQL Server'? I'm assuming that's using a deployment manifest file which opens the deployment wizard, is there a better way?
Packages error or hang in SQL Agent but not in BI IDE
Hi ,
I have an issues that worries me alot. I have SSIS packages scheduled in SQL Agent and they sometime error out or hang in Agent but never when i run them in BI IDE (Visual studio). There are two particular packages that always hang, alway in Agent but when i run them in BI IDE, they run just fine. Im was running them under in Agent under type= Sql server intergration services and also tried running under type = Operating System (CmdExec). Both types have the same problem. The packages hang. The log files dont say much, because the packages hang, no logging is doing so i dont get any infomation to determin what is going on. Can someone please help me ou.
Can you provide more information about the package:
What security settings are you using?
What tasks are in the package?
Where is the package hanging?
What log events do you have enabled?
Is it consistent? Happens everytime?
Does it happen if you run it under DTExec in the same credentials as under Agent?
Kirk Haselden
Author "SQL Server Integration Services"
The task contained the the package are two data flow componenet ( in which there is a download from a remote source to local sql sever destination server ) , two execute sql task from which a sql statement is set to a varaible and assigned to the sql property of the datasources (using expression) in the data flow componenets and lastly , email task to send emails if the packaged failed or passed.
I have all the log even enable except for those in relation to the pipelines like OnPipelinePostEndOfRowset
It hangs everytime the packages runs in Sql Agent but not in VS (BI IDE)
I have only run it with dtexec under Agent and its still hangs.|||
This won't work because EncryptSensitiveWithUserKey uses the credentials of the user on the machine where the package is built.
Change the package protection level to "Rely on server storage for encryption".
Save the package to SQL Server and then schedule the package to run in Agent.
Should fix the issue.
Kirk Haselden
Author "SQL Server Integration Services"
Have you actually tried doing this on SQL Server 2005 SP1? BIDS will not let you save a package with 'Server Storage' ProtectionLevel. Therefore, I can't build a deployment manifest where I get the 'Rely on server storage for encryption' option. Just what do you mean by 'save the package to SQL Server'? I'm assuming that's using a deployment manifest file which opens the deployment wizard, is there a better way?
|||this link describes how to save a package to sql server: http://msdn2.microsoft.com/en-us/library/ms137565.aspxDawnJ wrote:
Just what do you mean by 'save the package to SQL Server'? I'm assuming that's using a deployment manifest file which opens the deployment wizard, is there a better way?
PackageForTheWEB error
MSSQL 2000 in a clustered windows 2000 advance server.
I have observe the task manager what process was invoke
when the error appeared and it is MSSEARCH.EXE.
What can I do to complete my installation?
Thanks
Janz,
More info is necessary in order to troubleshoot this issue... Could you post
the full output of -- SELECT @.@.version -- Also, attach the file
SearchSetup.log that is usually located at C:\WINNT\ and as well as
sqlstp.log usually located at C:\WINNT\Temp\ and post any errors or issues
related to MSSearch in either of these logs. You can also attach these
files to your post and I'll review them as well. Is your clustered
environment an active/active or passive/active? Which node is this error
occurring on? If you fallover, does the error re-occur?
Note, you should also review your server's Application event log for any
"Microsoft Search" or MssCi source events, errors or warnings as this too
would be helpful info.
Regards,
John
"Janz" <anonymous@.discussions.microsoft.com> wrote in message
news:0ff101c48bd8$577838f0$a601280a@.phx.gbl...
> I'm having a package for the WEB error when installing
> MSSQL 2000 in a clustered windows 2000 advance server.
> I have observe the task manager what process was invoke
> when the error appeared and it is MSSEARCH.EXE.
> What can I do to complete my installation?
>
> Thanks
Package Validation Error in Custom PipelineComponent
Hi
I'm developing an PipelineComponent (ComponentType.Transform). When I try to execute this component, the following error is thrown:
Code Snippet
===================================
Package Validation Error (Package Validation Error)
===================================
Error at Data Flow Task [DTS.Pipeline]: Buffer Type 1 had a size of 0 bytes.
Error at Data Flow Task [DTS.Pipeline]: The buffer manager failed to create a new buffer type.
Error at Data Flow Task [DTS.Pipeline]: The Data Flow task cannot register a buffer type. The type had 50 columns and was for execution tree 0.
Error at Data Flow Task [DTS.Pipeline]: The layout failed validation.
Error at Data Flow Task: There were errors during task validation.
(Microsoft.DataTransformationServices.VsIntegration)
Program Location:
at Microsoft.DataTransformationServices.Project.DataTransformationsPackageDebugger.ValidateAndRunDebugger(Int32 flags, DataWarehouseProjectManager manager, IOutputWindow outputWindow, DataTransformationsProjectConfigurationOptions options)
at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, ProjectItem startupProjItem, DataTransformationsProjectConfigurationOptions options)
at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchActivePackage(Int32 launchOptions)
at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.LaunchDtsPackage(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)
at Microsoft.DataTransformationServices.Project.DataTransformationsProjectDebugger.Launch(Int32 launchOptions, DataTransformationsProjectConfigurationOptions options)
Can anyone help me, please? The "Integration Services Error and Message Reference" didn't help me much.
Thank you
Manuel Bauer
The error does not give me any clues other than it happens during a validation stage, so what is in your Validate method?
Have your tried debugging this, i.e. Visual Studio attached to the execution host?
|||Hi
Thank you for your answer. My pipeline component's validate method runs without any problems, I debugged this in design time and in run time (before the exception occured). In my opinion, the problem is the early validation (http://sqljunkies.com/WebLog/knight_reign/archive/2005/04/20/12365.aspx) of the data flow task. As I expect, the data flow task does any validation itself.
I can't imagine what "The Data Flow task cannot register a buffer type. The type had 50 columns and was for execution tree 0." means, so I really don't know where the problem could be.
The exception is thrown immediately after running the package (also after running the validate method of my pipeline component).
|||Does the package work if you take your component out of it?
The early validation vs late validation is the same Validate method calls, and since it generally works, I'd say it is clear that your transform has a problem, regardless of if it is the early or late call. Early and Late means normally Validate gets called twice, there is no difference between them. The Task will have a validate method, and a Data Flow will then call Validate for each child component.
How can the exception be thrown "after" running a package, Execute will never get called if a task fails validation. What is the return of your Validate method when you debug it?
Did you debug against dtsdebughost or just Visual Studio (designer)? For simplicity when trying to resolve run-time issues I set the code project debug option to use dtexec directly, just using /F and a package file. It is faster than attaching to a designer instance of VS.
|||I found a solution for my problem. I was thinking wrong about this validation thing, I thought that the data flow task does some independant, general validation itself.
In my component, I "forgot" to call base.Validate(), which would no be a problem if the own validate method is implemented as id should. In my case, it was not.
Thank you for your competent analysis of my problem.
Manuel Bauer
Package Validation Error + Code 0xC004801C
Hi,
I am learning to use SSIS for creating packages. I am getting the following error when I try to execute my package...
Package Validation Error
Error at Data Flow Task[DTS. Pipeline]:The "runtime connection "FlatFileConnection "(122)" in the connection manager collection, Connections, of component "Flat File Destination ("120") does not have a value for the ID property. Verify that the ConnectionManagerID property of the runtime connection object has been set for the component.
Error at Data Flow Task [DTS.Pipeline]: component "Flat File Destination" (120) failed validation and returned error code 0xC004801C.
Error at Data Flow Task[DTS.Pipeline]: One or more component failed validation.
Error at Data Flow Task: There were errors during task validation.
(Microsoft.DataTransformationServices.VsIntegration)
I'd appreciate if someone can help me with this. Do I need to change some settings? Also, what does the number in brackets indicate, say in FlatFileConnection(122)? Is it valuable information while debugging?
Just to give an idea, my package is like this -
source FlatFile -> Derived Column -> Lookup1 ->Lookup2 ->OLE DB destination(SQL server DB table)
Lookup1 and Lookup2 have error redirected to one flat file destination each.
Thanks in advance!
Geez....the error was just because I hadn't assigned a Connection Manager to that Flat File destination!! Oops!!!Friday, March 23, 2012
Package Validation Error
Hi,
I am using Look-UP Transformation to do ETL from a Flat file to a SQL Server Fact Table doing Keylookups from different Dimension Tables:
I am using two connections in the Connection manager, One for the FlatFile and one for the SQLServer Table..
While Executing the Package, I am getting the following error:
TITLE: Package Validation Error
Package Validation Error
ADDITIONAL INFORMATION:
Error at Data Flow Task [DTS.Pipeline]: The "runtime connection "OleDbConnection" (110)" in the connection manager collection, Connections, of "component "OLE DB Destination" (102)" does not have a value for the ID property. Verify that the ConnectionManagerID property of the runtime connection object has been set for the component.
Error at Data Flow Task [DTS.Pipeline]: component "OLE DB Destination" (102) failed validation and returned error code 0xC004801C.
Error at Data Flow Task [DTS.Pipeline]: One or more component failed validation.
Error at Data Flow Task: There were errors during task validation.
(Microsoft.DataTransformationServices.VsIntegration)
BUTTONS:
OK
Can anyone help me ?
Thanks in Advance,
Sundar
I guess this might help you:
http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=108043&SiteID=1
|||Make sure that in the flat file source and the destination that you have actually chosen a connection manager.You'll get this error if you don't chose a connection manager.|||
Thanks a lot Phil and Unni.
Once I configured the connection Manager, Package worked like a charm !!
Cheers,
Sundar
Package Validation Error
I have a package which takes a text file and imports data into a SQL table. It returns the Package Validation Error:
Error at Data Flow Task [SQL Server Destination [1430]]: Failure inserting into the read-only column "ZipCode".
The column ZipCode in the sql table is a varchar(50) column. I do not understand why it thinks the column is a read only column; if someone could shed some light on this I would greatly appreciate it.
Thanks!
GN
Take a closer look at the table, perhaps it is a calculated column. What is the CREATE TABLE statement for that table?|||It's not a calculated column. It is just a standard varchar column. The create table script generated by SQL is:
CREATETABLE [dbo].[ZipToState](
[ZipCode] [varchar](50)COLLATE SQL_Latin1_General_CP1_CI_AS NOTNULL,
[StateAbbr] [varchar](2)COLLATE SQL_Latin1_General_CP1_CI_AS NOTNULL,
[City] [varchar](50)COLLATE SQL_Latin1_General_CP1_CI_AS NOTNULL,
[PreferredCityName] [varchar](50)COLLATE SQL_Latin1_General_CP1_CI_AS NOTNULL,
[ID] [int] IDENTITY(1,1)NOTNULL
)ON [PRIMARY]
Actually I'm starting to think that it may actually be a permissions issue.
Thanks!
GN
|||Okay I've confirmed that it is a permission error.
When I use my login, which has sysadmin privleges, for the database connection there is no problem inserting into the table fields. When I use another login that does not have sysadmin privleges then the package errors out stating the field is read-only. I've the login the bulkadmin server role but I get the same error. I've also given the login the explicit server permission Administer bulk operations but I keep getting the same error. Additionally the login has insert, delete, and select permissions for the table. So does anyone know what permissions are needed for the login to be able to perform the bulk insert via the package?
Thanks!
Package Validation Error
I have a package which takes a text file and imports data into a SQL table. It returns the Package Validation Error:
Error at Data Flow Task [SQL Server Destination [1430]]: Failure inserting into the read-only column "ZipCode".
The column ZipCode in the sql table is a varchar(50) column. I do not understand why it thinks the column is a read only column; if someone could shed some light on this I would greatly appreciate it.
Thanks!
GN
Take a closer look at the table, perhaps it is a calculated column. What is the CREATE TABLE statement for that table?|||It's not a calculated column. It is just a standard varchar column. The create table script generated by SQL is:
CREATE TABLE [dbo].[ZipToState](
[ZipCode] [varchar](50) COLLATE SQL_Latin1_General_CP1_CI_AS NOT NULL,
[StateAbbr] [varchar](2) COLLATE SQL_Latin1_General_CP1_CI_AS NOT NULL,
[City] [varchar](50) COLLATE SQL_Latin1_General_CP1_CI_AS NOT NULL,
[PreferredCityName] [varchar](50) COLLATE SQL_Latin1_General_CP1_CI_AS NOT NULL,
[ID] [int] IDENTITY(1,1) NOT NULL
) ON [PRIMARY]
Actually I'm starting to think that it may actually be a permissions issue.
Thanks!
GN
|||Okay I've confirmed that it is a permission error.
When I use my login, which has sysadmin privleges, for the database connection there is no problem inserting into the table fields. When I use another login that does not have sysadmin privleges then the package errors out stating the field is read-only. I've the login the bulkadmin server role but I get the same error. I've also given the login the explicit server permission Administer bulk operations but I keep getting the same error. Additionally the login has insert, delete, and select permissions for the table. So does anyone know what permissions are needed for the login to be able to perform the bulk insert via the package?
Thanks!
Package scheduling and error trace-
I am scheduling the package to run on the nightly basis everyday using windows scheduled task.
How do i check whether the package ran successfully or it has given any error.
Can anyone please suggest me if I can log the error in some table of SQL server.
PLease suggest the steps.
When building a package in BIDS, have a look at the logging options. See the SSIS menu item, Logging.
You can log to several locations including a table.
I would expect DTEXEC to send the appropriate return code when it failed, so the scheduled job should fail. Unfortunately the windows scheduler is not very advanced, so you cannot capture output or configure the return code. The lack of output and monitoring means I would not use it.
Package runs fine in Debug.. fails outside of debug
I created a package that runs fine while in debug... but when I run outside of debug (just choosing Debug.. Start without debugging) I get an error of:
Message: The task "Formulate SQL Query and Destination" cannot run on this edition of Integration Services. It requires a higher level edition.
I am on SP1 on my workstation and the only SSIS server I have. I am not doing anything fancy in my script.. I have created other packages and ran outside of debug mode without issue. I did uninstall SQL2005 and SSIS from my workstation as it was eating up too many resources.
The script I am running is (removed some of the SQL etc to shorten it):
Imports System
Imports System.Data
Imports System.Math
Imports Microsoft.SqlServer.Dts.Runtime
Imports System.IO
Public Class ScriptMain
Public Sub Main()
' Create the SQL
Dim SQL As String
SQL += "SELECT "
SQL += " -- Lots of stuff"
SQL += "FROM "SQL += CStr(Dts.Variables("gvSourceTableName").Value) & " "
SQL += "WHERE "
SQL += " stuff = '" & CStr(Dts.Variables("gvCurrentSymbol").Value) & "' "
SQL += "ORDER BY date"
Dts.Variables("lvSQLQuery").Value = SQL
' MsgBox(CStr(Dts.Variables("lvSQLQuery").Value))
' Create the filename
Dim Dir As String
Dim FileName As String
Dim FullFileName As String
Dir = CStr(Dts.Variables("gvDestinationRoot").Value) & "\" & CStr(Dts.Variables("gvRunID").Value) & "\"
FileName = CStr(Dts.Variables("gvCurrentSymbol").Value) & "--.txt"
FullFileName = Dir & FileName
If Not Directory.Exists(Dir) Then
Directory.CreateDirectory(Dir)
End If
Dts.Variables("gvDestinationFile").Value = FullFileName
' MsgBox(CStr(Dts.Variables("gvDestinationFile").Value))
Dts.TaskResult = Dts.Results.Success
End Sub
End Class
FYI.. tried reinstalling 2005 SP1 on my workstation... still receiving the error message.|||This looks familiar. Try going to the SQL Server 2005 installer and install Integration Services on your local machine. The messages I've received that were similiar to this were solved by that. I believe you have the designer installed on your machine, but not the integration services engine. Good luck.|||Thanks, when I uninstalled SQL 2005 I must have took the SSIS stuff with it.. reinstalled SSIS server components and patch and works great now.|||Chris Honcoop wrote:
Thanks, when I uninstalled SQL 2005 I must have took the SSIS stuff with it.. reinstalled SSIS server components and patch and works great now.
You're welcome. You know, you'd think that a better error message could be raised... maybe something that actually says you don't have SSIS installed... oh well.
Wednesday, March 21, 2012
Package failure still causing partial load
I have a package that is failing because of a truncation error. Now, by default (and I leave this for ALL my packages) if one row fails processing the entire package should fail and nothing gets loaded into db. But instead I am actually getting a partial db load.
I have confirmed the "Rows per btach" value (blank) and the "Maximum insert commit size" value (0) for the OLE DB Destination Editor so I have no idea what is going on. Are there any other properties I should be checking?
Thanks.
Jason
Why are you surprised that there is a partial load? You'll have to set MICS to equal to or greater than the number of rows coming into the source to have it such that if one row is bad, the whole batch is aborted.The settings you have now are likely committing each row as they are inserted.|||According to the documentation, a "value of 0 indicates that all data is committed in a single batch after all rows have been processed". This, to me, tells me that all rows will be written or none. Since I am getting a truncation error, should I not be getting zero rows written?|||Well, I'm not so sure that SQL Server can accept an arbitrarily large bulk load. That is, I believe there's a limit to the size of the batch, and if it's exceeded, it will have to issue a commit or fail. I'm not sure.
You could redirect error rows out of the OLE DB command and try to see where that error occurs (row number or something).|||
Thanks for the responses Phil.
I know exactly where the error is happening. Just that in the past (with other packages) the execution loaded everything or nothing. (No matter the number of rows in the source.) It is just that the behavior for this package is not what I am used to and I cannot figure out why it is doing a partial load when the settings (as far as I can tell) are telling it not to.
- Jason
|||To be honest, I have been playing with those 2 properties in the OLE DB Destination, so I can get bigger batches but I only can get around 9K-10K rows per commit as maximum. Not sure if SSIS or Bulk_insert look at the available resources and decided what value to use. I have no gotten the time to dig into that.
|||Rafael Salas wrote:
To be honest, I have been playing with those 2 properties in the OLE DB Destination, so I can get bigger batches but I only can get around 9K-10K rows per commit as maximum. Not sure if SSIS or Bulk_insert look at the available resources and decided what value to use. I have no gotten the time to dig into that.
I think that SQL Server can only handle a batch size of 256 MB.
http://msdn2.microsoft.com/en-us/library/ms143432.aspx