Do I need to leave some extra space available on the disk which my database log files reside, for log backup...
If I size my log files to evenly split the entire drive they reside on, leaving no extra space available, will log backups still be able to occur successfully? I have several databases, with one log file per database.
Is it good practice to not leave any space on the drive available, i.e. allocate it all to the log files? (The drive is dedicated to the log files in this case, data and the OS live on their own partitions.)
sql-server sql-server-2008-r2 transaction-log disk-space logs
add a comment |
If I size my log files to evenly split the entire drive they reside on, leaving no extra space available, will log backups still be able to occur successfully? I have several databases, with one log file per database.
Is it good practice to not leave any space on the drive available, i.e. allocate it all to the log files? (The drive is dedicated to the log files in this case, data and the OS live on their own partitions.)
sql-server sql-server-2008-r2 transaction-log disk-space logs
add a comment |
If I size my log files to evenly split the entire drive they reside on, leaving no extra space available, will log backups still be able to occur successfully? I have several databases, with one log file per database.
Is it good practice to not leave any space on the drive available, i.e. allocate it all to the log files? (The drive is dedicated to the log files in this case, data and the OS live on their own partitions.)
sql-server sql-server-2008-r2 transaction-log disk-space logs
If I size my log files to evenly split the entire drive they reside on, leaving no extra space available, will log backups still be able to occur successfully? I have several databases, with one log file per database.
Is it good practice to not leave any space on the drive available, i.e. allocate it all to the log files? (The drive is dedicated to the log files in this case, data and the OS live on their own partitions.)
sql-server sql-server-2008-r2 transaction-log disk-space logs
sql-server sql-server-2008-r2 transaction-log disk-space logs
edited Mar 13 at 22:22
Max Vernon
51.7k13114229
51.7k13114229
asked Mar 13 at 18:09
J.D.J.D.
529314
529314
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
Well log backups don't change the size of the log file, and the only reason you'd need space on that drive is if you were backing up the log there (which is the same kind of bad idea as putting your house key and the backup on the same key ring). But a slightly different question, do you expect none of your log files to ever grow? Leaving a bit of space at least gives you some canary time where you can deal with a log file that is growing atypically. With no space leftover, as soon as the log file needs to grow, you're down.
The only reasoning I had behind leaving the extra space for the log backups is because I know in some types of backup or copy operations (outside of SQL, perhaps I've seen it at the OS level in Windows) roughly the same amount of space of the data being copied needs to be available to perform the copy operation. I wasn't sure if there was any similar methodology in how log backups work.
– J.D.
Mar 13 at 20:31
2
@J.D. That is how online index rebuilds work, but it's not how log backups work.
– Aaron Bertrand♦
Mar 13 at 20:32
Cool, I learned something new about index rebuilds now too. Thanks! :)
– J.D.
Mar 13 at 20:33
add a comment |
There is no technical problem for SQL Server if the drive where the log file exists has no free space, assuming the log itself doesn't run out of available, unused, VLF entries.
If the log runs out of available space, you'll not be able to commit any transactions until you resolve the problem. If the entire drive is consumed by the log file, the only action you can take is to add a log file on a different drive to the database. If you proactively manage your log file, and never run out of log space, there is no technical prohibition from doing what you're contemplating.
Having said that, I wouldn't recommend sizing your log file to consume all available drive space:
- Windows will complain about the disk being out of space, which can be annoying.
- If you do run out of log space, and you almost certainly will at some point, the database will not be accessible until you add a new log file.
- How much does disk space cost? Almost nothing in comparison with the price of SQL Server Enterprise Edition licensing, and the potential cost to the business from down-time. Ask yourself why you wouldn't leave a little space free on the drive. Please don't take this to mean I'm endorsing using the wrong data types such as using a
bigint
instead of anint
, or even asmallint
. Unused disk space is cheap, but space used inside a database should be considered premium cost for the reasons succinctly outlined by @SolomonRutzky here.
In a comment, you mentioned that you see no difference between a log growing to fill the disk, and the disk already being filled with a mostly empty log which subsequently gets filled. The supposition is correct, both events will result in the server returning the following error:
Msg 9002, Level 17, State 2, Line 22
The transaction log for database '<database_name>' is full due to 'LOG_BACKUP'.
However, if you have a SAN, you could thin-provision the drive with a maximum size of, say, 10TB. Create the log file with the estimated "correct" initial size, say 1GB, with growth set to 1GB (or whatever makes sense). Then you won't be using more SAN disk space than you need, but you'll have room to grow the log file without needing to involve the SAN administrator. Win-win.
In a previous version of my answer, I stated the following incorrect information:
Adding a log file when you're already out of log space can be impossible since the mere fact of adding a log file modifies the primary data file, which necessitates writing to the log. It's kind of a chicken-and-egg thing.
After some pretty extensive testing, I am able to successfully add a new log file after the existing log file runs out of space. I wrote a blog post showing how this works at SQLServerScience.com. The actions required for adding a new log file consist of:
- Physically creating the new file on disk
- Writing new VLF structures to the file
- Updating the existing log file - there must be enough space preallocated in the existing log file for just this purpose, that cannot be used for anything else.
- Updating the primary mdf to reflect the newly created log file.
The above was validated on SQL Server 2008 R2, and SQL Server 2016.
Comments are not for extended discussion; this conversation has been moved to chat.
– Paul White♦
Mar 13 at 23:49
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "182"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f232048%2fdo-i-need-to-leave-some-extra-space-available-on-the-disk-which-my-database-log%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
Well log backups don't change the size of the log file, and the only reason you'd need space on that drive is if you were backing up the log there (which is the same kind of bad idea as putting your house key and the backup on the same key ring). But a slightly different question, do you expect none of your log files to ever grow? Leaving a bit of space at least gives you some canary time where you can deal with a log file that is growing atypically. With no space leftover, as soon as the log file needs to grow, you're down.
The only reasoning I had behind leaving the extra space for the log backups is because I know in some types of backup or copy operations (outside of SQL, perhaps I've seen it at the OS level in Windows) roughly the same amount of space of the data being copied needs to be available to perform the copy operation. I wasn't sure if there was any similar methodology in how log backups work.
– J.D.
Mar 13 at 20:31
2
@J.D. That is how online index rebuilds work, but it's not how log backups work.
– Aaron Bertrand♦
Mar 13 at 20:32
Cool, I learned something new about index rebuilds now too. Thanks! :)
– J.D.
Mar 13 at 20:33
add a comment |
Well log backups don't change the size of the log file, and the only reason you'd need space on that drive is if you were backing up the log there (which is the same kind of bad idea as putting your house key and the backup on the same key ring). But a slightly different question, do you expect none of your log files to ever grow? Leaving a bit of space at least gives you some canary time where you can deal with a log file that is growing atypically. With no space leftover, as soon as the log file needs to grow, you're down.
The only reasoning I had behind leaving the extra space for the log backups is because I know in some types of backup or copy operations (outside of SQL, perhaps I've seen it at the OS level in Windows) roughly the same amount of space of the data being copied needs to be available to perform the copy operation. I wasn't sure if there was any similar methodology in how log backups work.
– J.D.
Mar 13 at 20:31
2
@J.D. That is how online index rebuilds work, but it's not how log backups work.
– Aaron Bertrand♦
Mar 13 at 20:32
Cool, I learned something new about index rebuilds now too. Thanks! :)
– J.D.
Mar 13 at 20:33
add a comment |
Well log backups don't change the size of the log file, and the only reason you'd need space on that drive is if you were backing up the log there (which is the same kind of bad idea as putting your house key and the backup on the same key ring). But a slightly different question, do you expect none of your log files to ever grow? Leaving a bit of space at least gives you some canary time where you can deal with a log file that is growing atypically. With no space leftover, as soon as the log file needs to grow, you're down.
Well log backups don't change the size of the log file, and the only reason you'd need space on that drive is if you were backing up the log there (which is the same kind of bad idea as putting your house key and the backup on the same key ring). But a slightly different question, do you expect none of your log files to ever grow? Leaving a bit of space at least gives you some canary time where you can deal with a log file that is growing atypically. With no space leftover, as soon as the log file needs to grow, you're down.
answered Mar 13 at 18:56
Aaron Bertrand♦Aaron Bertrand
153k18297492
153k18297492
The only reasoning I had behind leaving the extra space for the log backups is because I know in some types of backup or copy operations (outside of SQL, perhaps I've seen it at the OS level in Windows) roughly the same amount of space of the data being copied needs to be available to perform the copy operation. I wasn't sure if there was any similar methodology in how log backups work.
– J.D.
Mar 13 at 20:31
2
@J.D. That is how online index rebuilds work, but it's not how log backups work.
– Aaron Bertrand♦
Mar 13 at 20:32
Cool, I learned something new about index rebuilds now too. Thanks! :)
– J.D.
Mar 13 at 20:33
add a comment |
The only reasoning I had behind leaving the extra space for the log backups is because I know in some types of backup or copy operations (outside of SQL, perhaps I've seen it at the OS level in Windows) roughly the same amount of space of the data being copied needs to be available to perform the copy operation. I wasn't sure if there was any similar methodology in how log backups work.
– J.D.
Mar 13 at 20:31
2
@J.D. That is how online index rebuilds work, but it's not how log backups work.
– Aaron Bertrand♦
Mar 13 at 20:32
Cool, I learned something new about index rebuilds now too. Thanks! :)
– J.D.
Mar 13 at 20:33
The only reasoning I had behind leaving the extra space for the log backups is because I know in some types of backup or copy operations (outside of SQL, perhaps I've seen it at the OS level in Windows) roughly the same amount of space of the data being copied needs to be available to perform the copy operation. I wasn't sure if there was any similar methodology in how log backups work.
– J.D.
Mar 13 at 20:31
The only reasoning I had behind leaving the extra space for the log backups is because I know in some types of backup or copy operations (outside of SQL, perhaps I've seen it at the OS level in Windows) roughly the same amount of space of the data being copied needs to be available to perform the copy operation. I wasn't sure if there was any similar methodology in how log backups work.
– J.D.
Mar 13 at 20:31
2
2
@J.D. That is how online index rebuilds work, but it's not how log backups work.
– Aaron Bertrand♦
Mar 13 at 20:32
@J.D. That is how online index rebuilds work, but it's not how log backups work.
– Aaron Bertrand♦
Mar 13 at 20:32
Cool, I learned something new about index rebuilds now too. Thanks! :)
– J.D.
Mar 13 at 20:33
Cool, I learned something new about index rebuilds now too. Thanks! :)
– J.D.
Mar 13 at 20:33
add a comment |
There is no technical problem for SQL Server if the drive where the log file exists has no free space, assuming the log itself doesn't run out of available, unused, VLF entries.
If the log runs out of available space, you'll not be able to commit any transactions until you resolve the problem. If the entire drive is consumed by the log file, the only action you can take is to add a log file on a different drive to the database. If you proactively manage your log file, and never run out of log space, there is no technical prohibition from doing what you're contemplating.
Having said that, I wouldn't recommend sizing your log file to consume all available drive space:
- Windows will complain about the disk being out of space, which can be annoying.
- If you do run out of log space, and you almost certainly will at some point, the database will not be accessible until you add a new log file.
- How much does disk space cost? Almost nothing in comparison with the price of SQL Server Enterprise Edition licensing, and the potential cost to the business from down-time. Ask yourself why you wouldn't leave a little space free on the drive. Please don't take this to mean I'm endorsing using the wrong data types such as using a
bigint
instead of anint
, or even asmallint
. Unused disk space is cheap, but space used inside a database should be considered premium cost for the reasons succinctly outlined by @SolomonRutzky here.
In a comment, you mentioned that you see no difference between a log growing to fill the disk, and the disk already being filled with a mostly empty log which subsequently gets filled. The supposition is correct, both events will result in the server returning the following error:
Msg 9002, Level 17, State 2, Line 22
The transaction log for database '<database_name>' is full due to 'LOG_BACKUP'.
However, if you have a SAN, you could thin-provision the drive with a maximum size of, say, 10TB. Create the log file with the estimated "correct" initial size, say 1GB, with growth set to 1GB (or whatever makes sense). Then you won't be using more SAN disk space than you need, but you'll have room to grow the log file without needing to involve the SAN administrator. Win-win.
In a previous version of my answer, I stated the following incorrect information:
Adding a log file when you're already out of log space can be impossible since the mere fact of adding a log file modifies the primary data file, which necessitates writing to the log. It's kind of a chicken-and-egg thing.
After some pretty extensive testing, I am able to successfully add a new log file after the existing log file runs out of space. I wrote a blog post showing how this works at SQLServerScience.com. The actions required for adding a new log file consist of:
- Physically creating the new file on disk
- Writing new VLF structures to the file
- Updating the existing log file - there must be enough space preallocated in the existing log file for just this purpose, that cannot be used for anything else.
- Updating the primary mdf to reflect the newly created log file.
The above was validated on SQL Server 2008 R2, and SQL Server 2016.
Comments are not for extended discussion; this conversation has been moved to chat.
– Paul White♦
Mar 13 at 23:49
add a comment |
There is no technical problem for SQL Server if the drive where the log file exists has no free space, assuming the log itself doesn't run out of available, unused, VLF entries.
If the log runs out of available space, you'll not be able to commit any transactions until you resolve the problem. If the entire drive is consumed by the log file, the only action you can take is to add a log file on a different drive to the database. If you proactively manage your log file, and never run out of log space, there is no technical prohibition from doing what you're contemplating.
Having said that, I wouldn't recommend sizing your log file to consume all available drive space:
- Windows will complain about the disk being out of space, which can be annoying.
- If you do run out of log space, and you almost certainly will at some point, the database will not be accessible until you add a new log file.
- How much does disk space cost? Almost nothing in comparison with the price of SQL Server Enterprise Edition licensing, and the potential cost to the business from down-time. Ask yourself why you wouldn't leave a little space free on the drive. Please don't take this to mean I'm endorsing using the wrong data types such as using a
bigint
instead of anint
, or even asmallint
. Unused disk space is cheap, but space used inside a database should be considered premium cost for the reasons succinctly outlined by @SolomonRutzky here.
In a comment, you mentioned that you see no difference between a log growing to fill the disk, and the disk already being filled with a mostly empty log which subsequently gets filled. The supposition is correct, both events will result in the server returning the following error:
Msg 9002, Level 17, State 2, Line 22
The transaction log for database '<database_name>' is full due to 'LOG_BACKUP'.
However, if you have a SAN, you could thin-provision the drive with a maximum size of, say, 10TB. Create the log file with the estimated "correct" initial size, say 1GB, with growth set to 1GB (or whatever makes sense). Then you won't be using more SAN disk space than you need, but you'll have room to grow the log file without needing to involve the SAN administrator. Win-win.
In a previous version of my answer, I stated the following incorrect information:
Adding a log file when you're already out of log space can be impossible since the mere fact of adding a log file modifies the primary data file, which necessitates writing to the log. It's kind of a chicken-and-egg thing.
After some pretty extensive testing, I am able to successfully add a new log file after the existing log file runs out of space. I wrote a blog post showing how this works at SQLServerScience.com. The actions required for adding a new log file consist of:
- Physically creating the new file on disk
- Writing new VLF structures to the file
- Updating the existing log file - there must be enough space preallocated in the existing log file for just this purpose, that cannot be used for anything else.
- Updating the primary mdf to reflect the newly created log file.
The above was validated on SQL Server 2008 R2, and SQL Server 2016.
Comments are not for extended discussion; this conversation has been moved to chat.
– Paul White♦
Mar 13 at 23:49
add a comment |
There is no technical problem for SQL Server if the drive where the log file exists has no free space, assuming the log itself doesn't run out of available, unused, VLF entries.
If the log runs out of available space, you'll not be able to commit any transactions until you resolve the problem. If the entire drive is consumed by the log file, the only action you can take is to add a log file on a different drive to the database. If you proactively manage your log file, and never run out of log space, there is no technical prohibition from doing what you're contemplating.
Having said that, I wouldn't recommend sizing your log file to consume all available drive space:
- Windows will complain about the disk being out of space, which can be annoying.
- If you do run out of log space, and you almost certainly will at some point, the database will not be accessible until you add a new log file.
- How much does disk space cost? Almost nothing in comparison with the price of SQL Server Enterprise Edition licensing, and the potential cost to the business from down-time. Ask yourself why you wouldn't leave a little space free on the drive. Please don't take this to mean I'm endorsing using the wrong data types such as using a
bigint
instead of anint
, or even asmallint
. Unused disk space is cheap, but space used inside a database should be considered premium cost for the reasons succinctly outlined by @SolomonRutzky here.
In a comment, you mentioned that you see no difference between a log growing to fill the disk, and the disk already being filled with a mostly empty log which subsequently gets filled. The supposition is correct, both events will result in the server returning the following error:
Msg 9002, Level 17, State 2, Line 22
The transaction log for database '<database_name>' is full due to 'LOG_BACKUP'.
However, if you have a SAN, you could thin-provision the drive with a maximum size of, say, 10TB. Create the log file with the estimated "correct" initial size, say 1GB, with growth set to 1GB (or whatever makes sense). Then you won't be using more SAN disk space than you need, but you'll have room to grow the log file without needing to involve the SAN administrator. Win-win.
In a previous version of my answer, I stated the following incorrect information:
Adding a log file when you're already out of log space can be impossible since the mere fact of adding a log file modifies the primary data file, which necessitates writing to the log. It's kind of a chicken-and-egg thing.
After some pretty extensive testing, I am able to successfully add a new log file after the existing log file runs out of space. I wrote a blog post showing how this works at SQLServerScience.com. The actions required for adding a new log file consist of:
- Physically creating the new file on disk
- Writing new VLF structures to the file
- Updating the existing log file - there must be enough space preallocated in the existing log file for just this purpose, that cannot be used for anything else.
- Updating the primary mdf to reflect the newly created log file.
The above was validated on SQL Server 2008 R2, and SQL Server 2016.
There is no technical problem for SQL Server if the drive where the log file exists has no free space, assuming the log itself doesn't run out of available, unused, VLF entries.
If the log runs out of available space, you'll not be able to commit any transactions until you resolve the problem. If the entire drive is consumed by the log file, the only action you can take is to add a log file on a different drive to the database. If you proactively manage your log file, and never run out of log space, there is no technical prohibition from doing what you're contemplating.
Having said that, I wouldn't recommend sizing your log file to consume all available drive space:
- Windows will complain about the disk being out of space, which can be annoying.
- If you do run out of log space, and you almost certainly will at some point, the database will not be accessible until you add a new log file.
- How much does disk space cost? Almost nothing in comparison with the price of SQL Server Enterprise Edition licensing, and the potential cost to the business from down-time. Ask yourself why you wouldn't leave a little space free on the drive. Please don't take this to mean I'm endorsing using the wrong data types such as using a
bigint
instead of anint
, or even asmallint
. Unused disk space is cheap, but space used inside a database should be considered premium cost for the reasons succinctly outlined by @SolomonRutzky here.
In a comment, you mentioned that you see no difference between a log growing to fill the disk, and the disk already being filled with a mostly empty log which subsequently gets filled. The supposition is correct, both events will result in the server returning the following error:
Msg 9002, Level 17, State 2, Line 22
The transaction log for database '<database_name>' is full due to 'LOG_BACKUP'.
However, if you have a SAN, you could thin-provision the drive with a maximum size of, say, 10TB. Create the log file with the estimated "correct" initial size, say 1GB, with growth set to 1GB (or whatever makes sense). Then you won't be using more SAN disk space than you need, but you'll have room to grow the log file without needing to involve the SAN administrator. Win-win.
In a previous version of my answer, I stated the following incorrect information:
Adding a log file when you're already out of log space can be impossible since the mere fact of adding a log file modifies the primary data file, which necessitates writing to the log. It's kind of a chicken-and-egg thing.
After some pretty extensive testing, I am able to successfully add a new log file after the existing log file runs out of space. I wrote a blog post showing how this works at SQLServerScience.com. The actions required for adding a new log file consist of:
- Physically creating the new file on disk
- Writing new VLF structures to the file
- Updating the existing log file - there must be enough space preallocated in the existing log file for just this purpose, that cannot be used for anything else.
- Updating the primary mdf to reflect the newly created log file.
The above was validated on SQL Server 2008 R2, and SQL Server 2016.
edited Mar 19 at 15:25
answered Mar 13 at 18:20
Max VernonMax Vernon
51.7k13114229
51.7k13114229
Comments are not for extended discussion; this conversation has been moved to chat.
– Paul White♦
Mar 13 at 23:49
add a comment |
Comments are not for extended discussion; this conversation has been moved to chat.
– Paul White♦
Mar 13 at 23:49
Comments are not for extended discussion; this conversation has been moved to chat.
– Paul White♦
Mar 13 at 23:49
Comments are not for extended discussion; this conversation has been moved to chat.
– Paul White♦
Mar 13 at 23:49
add a comment |
Thanks for contributing an answer to Database Administrators Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f232048%2fdo-i-need-to-leave-some-extra-space-available-on-the-disk-which-my-database-log%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown