SSIS flat file csv destination twice the size of bcp csv export
up vote
0
down vote
favorite
I am having the problem that (despite the data being the exact same) when SSIS flat file destination to csv generates a file that is roughly twice the size of the CSV file generated by BCP. The files that are created have the same data as well.
file csv ssis size bcp
edited Nov 16 at 2:21
Mohsen mokhtari
1,2461023
asked Nov 15 at 20:05
kgs39
1
add a comment |
up vote
0
down vote
favorite
I am having the problem that (despite the data being the exact same) when SSIS flat file destination to csv generates a file that is roughly twice the size of the CSV file generated by BCP. The files that are created have the same data as well.
file csv ssis size bcp
edited Nov 16 at 2:21
Mohsen mokhtari
1,2461023
asked Nov 15 at 20:05
kgs39
1
Welcome to Stackoverflow! Can you please provide more detail, and an example?
– Jordon Bedwell
Nov 15 at 21:05
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I am having the problem that (despite the data being the exact same) when SSIS flat file destination to csv generates a file that is roughly twice the size of the CSV file generated by BCP. The files that are created have the same data as well.
file csv ssis size bcp
edited Nov 16 at 2:21
Mohsen mokhtari
1,2461023
asked Nov 15 at 20:05
kgs39
1
I am having the problem that (despite the data being the exact same) when SSIS flat file destination to csv generates a file that is roughly twice the size of the CSV file generated by BCP. The files that are created have the same data as well.
file csv ssis size bcp
file csv ssis size bcp
edited Nov 16 at 2:21
Mohsen mokhtari
1,2461023
asked Nov 15 at 20:05
kgs39
1
edited Nov 16 at 2:21
Mohsen mokhtari
1,2461023
asked Nov 15 at 20:05
kgs39
1
edited Nov 16 at 2:21
Mohsen mokhtari
1,2461023
edited Nov 16 at 2:21
Mohsen mokhtari
1,2461023
edited Nov 16 at 2:21
Mohsen mokhtari
1,2461023
1,2461023
asked Nov 15 at 20:05
kgs39
1
asked Nov 15 at 20:05
kgs39
1
asked Nov 15 at 20:05
kgs39
1
1
Welcome to Stackoverflow! Can you please provide more detail, and an example?
– Jordon Bedwell
Nov 15 at 21:05
add a comment |
Welcome to Stackoverflow! Can you please provide more detail, and an example?
– Jordon Bedwell
Nov 15 at 21:05
Welcome to Stackoverflow! Can you please provide more detail, and an example?
– Jordon Bedwell
Nov 15 at 21:05
Welcome to Stackoverflow! Can you please provide more detail, and an example?
– Jordon Bedwell
Nov 15 at 21:05
add a comment |
1 Answer
1
active
oldest
votes
up vote
1
down vote
A good rule of thumb is that if the "same" file is twice as large as another file, check your encodings. This smells like the file generated from SSIS is storing as Unicode (16 bytes per character) versus BCP using (8 bytes per character)
To fix this, look at your Flat File Connection manager. There is a checkbox for Unicode and if it's checked, uncheck it.
(Yes, that's a gross generalization of code points, pages etc but good enough for this question)
answered Nov 15 at 20:12
billinkc
45.6k980120
perfect - thanks!
– kgs39
Nov 16 at 14:02
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53327147%2fssis-flat-file-csv-destination-twice-the-size-of-bcp-csv-export%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
1
down vote
A good rule of thumb is that if the "same" file is twice as large as another file, check your encodings. This smells like the file generated from SSIS is storing as Unicode (16 bytes per character) versus BCP using (8 bytes per character)
To fix this, look at your Flat File Connection manager. There is a checkbox for Unicode and if it's checked, uncheck it.
(Yes, that's a gross generalization of code points, pages etc but good enough for this question)
answered Nov 15 at 20:12
billinkc
45.6k980120
perfect - thanks!
– kgs39
Nov 16 at 14:02
add a comment |
up vote
1
down vote
A good rule of thumb is that if the "same" file is twice as large as another file, check your encodings. This smells like the file generated from SSIS is storing as Unicode (16 bytes per character) versus BCP using (8 bytes per character)
To fix this, look at your Flat File Connection manager. There is a checkbox for Unicode and if it's checked, uncheck it.
(Yes, that's a gross generalization of code points, pages etc but good enough for this question)
answered Nov 15 at 20:12
billinkc
45.6k980120
perfect - thanks!
– kgs39
Nov 16 at 14:02
add a comment |
up vote
1
down vote
up vote
1
down vote
A good rule of thumb is that if the "same" file is twice as large as another file, check your encodings. This smells like the file generated from SSIS is storing as Unicode (16 bytes per character) versus BCP using (8 bytes per character)
To fix this, look at your Flat File Connection manager. There is a checkbox for Unicode and if it's checked, uncheck it.
(Yes, that's a gross generalization of code points, pages etc but good enough for this question)
answered Nov 15 at 20:12
billinkc
45.6k980120
A good rule of thumb is that if the "same" file is twice as large as another file, check your encodings. This smells like the file generated from SSIS is storing as Unicode (16 bytes per character) versus BCP using (8 bytes per character)
To fix this, look at your Flat File Connection manager. There is a checkbox for Unicode and if it's checked, uncheck it.
(Yes, that's a gross generalization of code points, pages etc but good enough for this question)
answered Nov 15 at 20:12
billinkc
45.6k980120
answered Nov 15 at 20:12
billinkc
45.6k980120
answered Nov 15 at 20:12
billinkc
45.6k980120
answered Nov 15 at 20:12
billinkc
45.6k980120
45.6k980120
perfect - thanks!
– kgs39
Nov 16 at 14:02
add a comment |
perfect - thanks!
– kgs39
Nov 16 at 14:02
perfect - thanks!
– kgs39
Nov 16 at 14:02
perfect - thanks!
– kgs39
Nov 16 at 14:02
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53327147%2fssis-flat-file-csv-destination-twice-the-size-of-bcp-csv-export%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Welcome to Stackoverflow! Can you please provide more detail, and an example?
– Jordon Bedwell
Nov 15 at 21:05