On Premise Object StoreWhere does youtube store so many videos?How to store all static media files of a...
What type of postprocessing gives the effect of people standing out
Difference between 小吃 and 零食
If nine coins are tossed, what is the probability that the number of heads is even?
Do authors have to be politically correct in article-writing?
What can I substitute for soda pop in a sweet pork recipe?
Second-rate spelling
Navigating through USB drive with "cd /myOtherFolder" causes "no such directory" error
When was drinking water recognized as crucial in marathon running?
Where was Karl Mordo in Infinity War?
What is better: yes / no radio, or simple checkbox?
How do ISS astronauts "get their stripes"?
Rationale to prefer local variables over instance variables?
What if I store 10TB on azure servers and then keep the vm powered off?
Has the Isbell–Freyd criterion ever been used to check that a category is concretisable?
If a druid in Wild Shape swallows a creature whole, then turns back to her normal form, what happens?
Do Hexblade warlocks choose their spells from the Hexblade spell list or the warlock spell list?
Called into a meeting and told we are being made redundant (laid off) and "not to share outside". Can I tell my partner?
How can I be pwned if I'm not registered on that site?
Is there a low-level alternative to Animate Objects?
Should I choose Itemized or Standard deduction?
Is there a ternary operator in math
It took me a lot of time to make this, pls like. (YouTube Comments #1)
Borrowing Characters
How do you say "powers of ten"?
On Premise Object Store
Where does youtube store so many videos?How to store all static media files of a website with heavy traffic?solution to store 10TB /MonthWhy should I choose an Enterprise Storage Vendor?S3-compatible Object Storage systemsHow do the file sharing websites store such huge amounts of data?HW/SW Design: 2 Petabyte of storageScalable NAS: on-premise and minimum of 6 TBCreating a scalable back-up cluster with one interface and retentionHow to safely store data and DBs on Kubernetes (or similar) on DigitalOcean
We have a need to store unstructured data that is coming from various nodes to a centralized system where this data will be archived and analytics apps built on top of it.
Each dataset can be ~200 MB in size with ~1000 datasets coming in per day and with a retention period of about a year, the system needs to store ~70 TB of data at peak load (i.e 200 MB per data * 1000 datasets per day * 365 days = ~70TB).
The software for the system I am working on is built using .NET stack and one of the constraints is that the system needs to be on-premise (public cloud is not an option and we also 'cannot' use Azure Stack for now, looks like it needs specialized hardware)
I was thinking a of using an on-premise Object store (for high scalability reasons and also at reasonable latency). Any on-premise object store solutions that you would recommend (I just see a lot of solutions from EMC, Minio, IBM, HP, Hitachi etc) and find it hard to get a comparative study?
Easy interop with .NET stack would be an important factor for me.
storage .net distributed-filesystems
asked 24 mins ago
SanthoshSanthosh
101113
add a comment |
We have a need to store unstructured data that is coming from various nodes to a centralized system where this data will be archived and analytics apps built on top of it.
Each dataset can be ~200 MB in size with ~1000 datasets coming in per day and with a retention period of about a year, the system needs to store ~70 TB of data at peak load (i.e 200 MB per data * 1000 datasets per day * 365 days = ~70TB).
The software for the system I am working on is built using .NET stack and one of the constraints is that the system needs to be on-premise (public cloud is not an option and we also 'cannot' use Azure Stack for now, looks like it needs specialized hardware)
I was thinking a of using an on-premise Object store (for high scalability reasons and also at reasonable latency). Any on-premise object store solutions that you would recommend (I just see a lot of solutions from EMC, Minio, IBM, HP, Hitachi etc) and find it hard to get a comparative study?
Easy interop with .NET stack would be an important factor for me.
storage .net distributed-filesystems
asked 24 mins ago
SanthoshSanthosh
101113
Sorry, but hard- and software recommendations are off topic for this site.
– Gerald Schneider
21 mins ago
add a comment |
We have a need to store unstructured data that is coming from various nodes to a centralized system where this data will be archived and analytics apps built on top of it.
Each dataset can be ~200 MB in size with ~1000 datasets coming in per day and with a retention period of about a year, the system needs to store ~70 TB of data at peak load (i.e 200 MB per data * 1000 datasets per day * 365 days = ~70TB).
The software for the system I am working on is built using .NET stack and one of the constraints is that the system needs to be on-premise (public cloud is not an option and we also 'cannot' use Azure Stack for now, looks like it needs specialized hardware)
I was thinking a of using an on-premise Object store (for high scalability reasons and also at reasonable latency). Any on-premise object store solutions that you would recommend (I just see a lot of solutions from EMC, Minio, IBM, HP, Hitachi etc) and find it hard to get a comparative study?
Easy interop with .NET stack would be an important factor for me.
storage .net distributed-filesystems
asked 24 mins ago
SanthoshSanthosh
101113
We have a need to store unstructured data that is coming from various nodes to a centralized system where this data will be archived and analytics apps built on top of it.
Each dataset can be ~200 MB in size with ~1000 datasets coming in per day and with a retention period of about a year, the system needs to store ~70 TB of data at peak load (i.e 200 MB per data * 1000 datasets per day * 365 days = ~70TB).
The software for the system I am working on is built using .NET stack and one of the constraints is that the system needs to be on-premise (public cloud is not an option and we also 'cannot' use Azure Stack for now, looks like it needs specialized hardware)
I was thinking a of using an on-premise Object store (for high scalability reasons and also at reasonable latency). Any on-premise object store solutions that you would recommend (I just see a lot of solutions from EMC, Minio, IBM, HP, Hitachi etc) and find it hard to get a comparative study?
Easy interop with .NET stack would be an important factor for me.
storage .net distributed-filesystems
storage .net distributed-filesystems
asked 24 mins ago
SanthoshSanthosh
101113
asked 24 mins ago
SanthoshSanthosh
101113
asked 24 mins ago
SanthoshSanthosh
101113
asked 24 mins ago
SanthoshSanthosh
101113
asked 24 mins ago
SanthoshSanthosh
101113
101113
Sorry, but hard- and software recommendations are off topic for this site.
– Gerald Schneider
21 mins ago
add a comment |
Sorry, but hard- and software recommendations are off topic for this site.
– Gerald Schneider
21 mins ago
Sorry, but hard- and software recommendations are off topic for this site.
– Gerald Schneider
21 mins ago
Sorry, but hard- and software recommendations are off topic for this site.
– Gerald Schneider
21 mins ago
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "2"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f956801%2fon-premise-object-store%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f956801%2fon-premise-object-store%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Sorry, but hard- and software recommendations are off topic for this site.
– Gerald Schneider
21 mins ago