U4-7486 - Get timeout issue when upgrading to 7.3.3 with a large number of documents

Created by Nadia Maclaren 02 Dec 2015, 23:50:33 Updated by Murray Roke 19 Jun 2017, 01:06:48

Relates to: U4-7869

'''What did you do?''' Upgraded from 7.1.8 to 7.3.3. using nuget package installer. It worked on my development environment.

I then deployed to our Azure staging environment, and reran the install process. This then gave me a timeout error. The DTU %hit 100 on the Azure DB, even after scaling up

'''What did you expect to happen?'''

Site upgrades to 7.3.3

'''What actually happened?'''

Returned the following error

{{Server Error in '/' Application.

The wait operation timed out

Description: An unhandled exception occurred during the execution of the current web request. Please review the stack trace for more information about the error and where it originated in the code.

Exception Details: System.ComponentModel.Win32Exception: The wait operation timed out

Source Error:

An unhandled exception was generated during the execution of the current web request. Information regarding the origin and location of the exception can be identified using the exception stack trace below.

Stack Trace:

[Win32Exception (0x80004005): The wait operation timed out]

[SqlException (0x80131904): Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.]}} System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action1 wrapCloseInAction) +3243748 System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose) +345 System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady) +4927 System.Data.SqlClient.SqlDataReader.TrySetMetaData(_SqlMetaDataSet metaData, Boolean moreInfo) +267 System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady) +3771 System.Data.SqlClient.SqlDataReader.TryConsumeMetaData() +92 System.Data.SqlClient.SqlDataReader.get_MetaData() +102 System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString) +552 System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async, Int32 timeout, Task& task, Boolean asyncWrite, SqlDataReader ds, Boolean describeParameterEncryptionRequest) +3140 System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, TaskCompletionSource1 completion, Int32 timeout, Task& task, Boolean asyncWrite) +554 System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method) +98 System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method) +307 Umbraco.Core.Persistence.<>c__DisplayClass4.b__3() +175 Umbraco.Core.Persistence.FaultHandling.RetryPolicy.ExecuteAction(Func1 func) +385 Umbraco.Core.Persistence.<Query>d__1c1.MoveNext() +1055 System.Collections.Generic.List1..ctor(IEnumerable1 collection) +452 System.Linq.Enumerable.ToList(IEnumerable1 source) +70 Umbraco.Core.Persistence.Repositories.ContentRepository.ProcessQuery(Sql sql) +108 Umbraco.Core.Persistence.Repositories.VersionableRepositoryBase2.GetPagedResultsByQuery(IQuery1 query, Int64 pageIndex, Int32 pageSize, Int64& totalRecords, Tuple2 nodeIdSelect, Func2 processQuery, String orderBy, Direction orderDirection, Func1 defaultFilter) +2103 Umbraco.Core.Persistence.Repositories.ContentRepository.GetPagedResultsByQuery(IQuery1 query, Int64 pageIndex, Int32 pageSize, Int64& totalRecords, String orderBy, Direction orderDirection, String filter) +750 Umbraco.Core.Services.ContentService.GetPagedDescendants(Int32 id, Int64 pageIndex, Int32 pageSize, Int64& totalChildren, String orderBy, Direction orderDirection, String filter) +961 UmbracoExamine.UmbracoContentIndexer.PerformIndexAll(String type) +396 UmbracoExamine.BaseUmbracoIndexer.IndexAll(String type) +35 UmbracoExamine.BaseUmbracoIndexer.PerformIndexRebuild() +112 UmbracoExamine.UmbracoContentIndexer.RebuildIndex() +86 Examine.ExamineManager._RebuildIndex() in x:\Projects\Examine\Examine\Projects\Examine\ExamineManager.cs:238 Umbraco.Web.WebBootManager.<InitializeResolvers>b__c() +282 Umbraco.Core.Sync.DatabaseServerMessenger.Initialize() +361 Umbraco.Web.BatchedDatabaseServerMessengerStartup.ApplicationStarted(UmbracoApplicationBase umbracoApplication, ApplicationContext applicationContext) +87 Umbraco.Core.ApplicationEventHandler.OnApplicationStarted(UmbracoApplicationBase umbracoApplication, ApplicationContext applicationContext) +50 Umbraco.Core.CoreBootManager.<Complete>b__8(IApplicationEventHandler x) +189 Umbraco.Core.EnumerableExtensions.ForEach(IEnumerable1 items, Action1 action) +167 Umbraco.Core.CoreBootManager.Complete(Action1 afterComplete) +467 Umbraco.Web.WebBootManager.Complete(Action`1 afterComplete) +82 Umbraco.Core.UmbracoApplicationBase.StartApplication(Object sender, EventArgs e) +364

[HttpException (0x80004005): Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.] System.Web.HttpApplicationFactory.EnsureAppStartCalledForIntegratedMode(HttpContext context, HttpApplication app) +544 System.Web.HttpApplication.RegisterEventSubscriptionsWithIIS(IntPtr appContext, HttpContext context, MethodInfo[] handlers) +186 System.Web.HttpApplication.InitSpecial(HttpApplicationState state, MethodInfo[] handlers, IntPtr appContext, HttpContext context) +172 System.Web.HttpApplicationFactory.GetSpecialApplicationInstance(IntPtr appContext, HttpContext context) +402 System.Web.Hosting.PipelineRuntime.InitializeApplication(IntPtr appContext) +343

[HttpException (0x80004005): Timeout expired. The timeout period elapsed prior to completion of the operation or the server is not responding.] System.Web.HttpRuntime.FirstRequestInit(HttpContext context) +579 System.Web.HttpRuntime.EnsureFirstRequestInit(HttpContext context) +112 System.Web.HttpRuntime.ProcessRequestNotificationPrivate(IIS7WorkerRequest wr, HttpContext context) +712

Comments

Murray Roke 19 Jun 2017, 01:06:14

I get this exception on first load of a website when pionting to a database that needs updating. I do know there's a lot of uMigrate migrations running on this app-start, but I don't see an indication in the stack trace I got. subsequent app start work as expected.

I repeated the process twice and got the same results on frist run against the DB that needed updating.

I'm on version 7.4.3

[Win32Exception (0x80004005): The wait operation timed out]

[SqlException (0x80131904): Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.] System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action1 wrapCloseInAction) +2442598 System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action1 wrapCloseInAction) +5766516 System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose) +285 System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady) +4162 System.Data.SqlClient.SqlDataReader.TrySetMetaData(_SqlMetaDataSet metaData, Boolean moreInfo) +198 System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady) +3162 System.Data.SqlClient.SqlDataReader.TryConsumeMetaData() +58 System.Data.SqlClient.SqlDataReader.get_MetaData() +89 System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString, Boolean isInternal, Boolean forDescribeParameterEncryption) +409 System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async, Int32 timeout, Task& task, Boolean asyncWrite, Boolean inRetry, SqlDataReader ds, Boolean describeParameterEncryptionRequest) +2031 System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, TaskCompletionSource1 completion, Int32 timeout, Task& task, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry) +911 System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method) +64 System.Data.SqlClient.SqlCommand.ExecuteReader(CommandBehavior behavior, String method) +240 System.Data.SqlClient.SqlCommand.ExecuteDbDataReader(CommandBehavior behavior) +41 System.Data.Common.DbCommand.ExecuteReader(CommandBehavior behavior) +12 StackExchange.Profiling.Data.ProfiledDbCommand.ExecuteDbDataReader(CommandBehavior behavior) in c:\Code\github\SamSaffron\MiniProfiler\StackExchange.Profiling\Data\ProfiledDbCommand.cs:235 System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader() +14 Umbraco.Core.Persistence.<>c__DisplayClass4.<ExecuteReaderWithRetry>b__3() +99 Umbraco.Core.Persistence.FaultHandling.RetryPolicy.ExecuteAction(Func1 func) +170 Umbraco.Core.Persistence.PetaPocoCommandExtensions.ExecuteReaderWithRetry(IDbCommand command, RetryPolicy cmdRetryPolicy, RetryPolicy conRetryPolicy) +118 Umbraco.Core.Persistence.PetaPocoCommandExtensions.ExecuteReaderWithRetry(IDbCommand command, RetryPolicy retryPolicy) +52 Umbraco.Core.Persistence.PetaPocoCommandExtensions.ExecuteReaderWithRetry(IDbCommand command) +49 Umbraco.Core.Persistence.d__1c1.MoveNext() +168 System.Collections.Generic.List1..ctor(IEnumerable1 collection) +275 System.Linq.Enumerable.ToList(IEnumerable1 source) +58 Umbraco.Core.Persistence.Database.Fetch(Sql sql) +117 Umbraco.Core.Persistence.Repositories.ContentRepository.ProcessQuery(Sql sql) +72 Umbraco.Core.Persistence.Repositories.VersionableRepositoryBase2.GetPagedResultsByQuery(IQuery1 query, Int64 pageIndex, Int32 pageSize, Int64& totalRecords, Tuple2 nodeIdSelect, Func2 processQuery, String orderBy, Direction orderDirection, Func1 defaultFilter) +1158 Umbraco.Core.Persistence.Repositories.ContentRepository.GetPagedResultsByQuery(IQuery1 query, Int64 pageIndex, Int32 pageSize, Int64& totalRecords, String orderBy, Direction orderDirection, String filter) +473 Umbraco.Core.Services.ContentService.GetPagedDescendants(Int32 id, Int64 pageIndex, Int32 pageSize, Int64& totalChildren, String orderBy, Direction orderDirection, String filter) +692 UmbracoExamine.UmbracoContentIndexer.PerformIndexAll(String type) +269 Examine.LuceneEngine.Providers.LuceneIndexer.IndexAll(String type) in X:\Projects\Examine\Examine\Projects\Examine\LuceneEngine\Providers\LuceneIndexer.cs:786 UmbracoExamine.BaseUmbracoIndexer.IndexAll(String type) +29 UmbracoExamine.BaseUmbracoIndexer.PerformIndexRebuild() +80 Examine.LuceneEngine.Providers.LuceneIndexer.RebuildIndex() in X:\Projects\Examine\Examine\Projects\Examine\LuceneEngine\Providers\LuceneIndexer.cs:741 UmbracoExamine.UmbracoContentIndexer.RebuildIndex() +53 Umbraco.Web.WebBootManager.b__f() +129 Umbraco.Core.Sync.DatabaseServerMessenger.Initialize() +593 Umbraco.Core.Sync.DatabaseServerMessenger.Boot() +87 Umbraco.Web.BatchedDatabaseServerMessenger.Startup() +186 Umbraco.Web.BatchedDatabaseServerMessengerStartup.ApplicationStarted(UmbracoApplicationBase umbracoApplication, ApplicationContext applicationContext) +63 Umbraco.Core.ApplicationEventHandler.OnApplicationStarted(UmbracoApplicationBase umbracoApplication, ApplicationContext applicationContext) +37 Umbraco.Core.CoreBootManager.b__a(IApplicationEventHandler x) +230 Umbraco.Core.EnumerableExtensions.ForEach(IEnumerable1 items, Action1 action) +141 Umbraco.Core.CoreBootManager.Complete(Action1 afterComplete) +293 Umbraco.Web.WebBootManager.Complete(Action1 afterComplete) +114 Umbraco.Core.UmbracoApplicationBase.StartApplication(Object sender, EventArgs e) +234 Umbraco.Core.UmbracoApplicationBase.Application_Start(Object sender, EventArgs e) +34

[HttpException (0x80004005): Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.] System.Web.HttpApplicationFactory.EnsureAppStartCalledForIntegratedMode(HttpContext context, HttpApplication app) +9982481 System.Web.HttpApplication.RegisterEventSubscriptionsWithIIS(IntPtr appContext, HttpContext context, MethodInfo[] handlers) +118 System.Web.HttpApplication.InitSpecial(HttpApplicationState state, MethodInfo[] handlers, IntPtr appContext, HttpContext context) +172 System.Web.HttpApplicationFactory.GetSpecialApplicationInstance(IntPtr appContext, HttpContext context) +336 System.Web.Hosting.PipelineRuntime.InitializeApplication(IntPtr appContext) +296

[HttpException (0x80004005): Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.] System.Web.HttpRuntime.FirstRequestInit(HttpContext context) +9963856 System.Web.HttpRuntime.EnsureFirstRequestInit(HttpContext context) +101 System.Web.HttpRuntime.ProcessRequestNotificationPrivate(IIS7WorkerRequest wr, HttpContext context) +254

Version Information: Microsoft .NET Framework Version:4.0.30319; ASP.NET Version:4.6.1637.0


Priority: Normal

Type: Bug

State: Submitted

Assignee:

Difficulty: Normal

Category:

Backwards Compatible: True

Fix Submitted:

Affected versions: 7.4.3

Due in version:

Sprint:

Story Points:

Cycle: