Data Center - TechRepublic
ServeTheHome: Server, Storage, Networking and Open Source Software News and Reviews
Hyper-converged infrastructure starts to offer greater choice tightly integrates storage, compute, networking and server virtualization resources in the same box
如何保护你在服务器里的数据？How Do We Protect Data in Servers?丨科普丨冷知识丨柴知道 ChaiKnows - YouTube
Arctic Vault | GitHub Archive Program
Clusters
Open MPI: Open Source High Performance Computing
Processors
4 Categories
Standard: cost-effective CPUs with moderate performance
Advanced: CPUs offering the highest performance for most applications
High Core Count: ideal for highly multi-threaded applications; CPUs providing the highest number of processor cores (sometimes sacrificing clock frequency in favor of core count)
Frequency Optimized: ideal for non-parallel/single-threaded applications; CPUs with the highest clock speeds (sacrificing number of cores in order to provide the highest frequencies)
In-Depth Comparison of Intel Xeon E5-2600v2 "Ivy Bridge" Processors | Microway
Detailed Specifications of the Intel Xeon E5-2600v3 "Haswell-EP" Processors | Microway
Detailed Specifications of the Intel Xeon E5-2600v4 "Broadwell-EP" Processors | Microway
Intel Xeon E5-2600 V4 "Broadwell-EP" Launched - First Benchmarks
Specifications of the Intel Xeon E5-4600 v3 "Haswell-EP" CPUs
In-Depth Comparison of Intel Xeon E5-4600v2 "Ivy Bridge" Processors | Microway
Storage
Storage Technology information, news and tips - SearchStorage
Enterprise Drives: Fact or Fiction? Backblaze built their solution on consumer grade SATA HDDs
A Look at How Backblaze Buys Petabytes of Hard Drive Storage
see
cloud-backup.md#storage-pods
What is storage volume? - Definition from WhatIs.com
Capabilities and limitations of thin-provisioned capacity
Interface/Protocol
SAS (serial attached SCSI) and SATA uses the same connector. Its the protocol over the wire that contributes to the different in characteristics. In terms of reliability and error rate SAS disks are much better compared to the old SATA disks.
SAS and SATA for Server Storage !important
Understanding the difference between SAS, SATA and Near Line SAS Hard drives to select for servers. | Outsourced IT and Cloud Computing Technology
SAS vs Near-line SAS vs SATA - Server Fault
Why is Enterprise Storage so expensive? - Server Fault
[SOLVED] Enterprise SATA vs NL SAS (WD RE drives) - Data Storage - Spiceworks
What is nearline storage? - Definition from WhatIs.com
What is iSCSI (Internet Small Computer System Interface)? - Definition from WhatIs.com
What you need to know about improving iSCSI performance
Physical Connection
Performance Characteristics of Common Network Fabrics | Microway
NETGEAR_Whitepaper_10_Gigabit.pdf iSCSI/Ethernet
Storage Types
Block vs File vs Object
DAS = Direct Attached Storage (drives inside a server node)
HBA = host bus adapter (offload network processing from CPU in FC SAN)
JBOD?
Storage area network - Wikiwand
Network-attached storage - Wikiwand
Object storage - Wikiwand
Introduction to Storage Area Networks (PDF)
How to create a high-availability configuration with Synology NAS - Tutorials - Synology - Network Attached Storage (NAS)
storage - What is the difference between SAN, NAS and DAS? - Server Fault
SAN vs NAS - Difference between a Storage Area Network and Network Attached Storage
SAN vs. NAS architecture: How do the two storage systems compare?
What is a SAN and how does it differ from NAS? | Network World
SAN Versus NAS: What's the Difference and What Do You Need? - Zadara Storage
Nas-San Comparison
Unified storage unit supports SAN and NAS, with FC and iSCSI interface
What is unified storage (multiprotocol storage)? - Definition from WhatIs.com
Unified storage architecture: Different approaches, scalability and capacity-saving tools
Multiprotocol unified storage systems poised for growth survey
What does unified storage really mean?
Defining storage-area networks (SANs), network-attached storage (NAS) and unified storage
SAN
- provides access to blocks
- typically with fiber connection
- use Fiber Channel (possibly over Ethernet) or iSCSI (SCSI over IP) protocol
- servers treat them like DAS (direct attached storage)
- file system is managed by servers
- only one client has access to the resource
SAN (Storage Area Network) Switches - SearchStorage.com
Storage Area Network School: Table of contents
NAS
- provides access to files
- typically with Ethernet connection (1GbE/10GbE)
- has its own IP address
- server mounts to the NAS
- manages the file system internally (NFS/CIFS/GlusterFS/CephFS)
- multiple clients have access to the resource
NAS (Network Attached Storage) management news and research - SearchStorage.com
How to buy NAS systems for any organization
When purchasing NAS products, look before you leap
The ultimate network-attached storage guide
Clustered NAS vs traditional NAS solutions
NAS tackles enterprise storage
QNAP Storage Performance Best Practice :: Storage ::NAS :: QNAP
Object Storage
- provides access to objects (files)
- objects are stored in a flat namespace
- objects can be associated with external metadata to provide hierarchy
- optimizations in metadata can cater different use cases
Object storage resources and information - SearchStorage
Why object-oriented storage and interactive apps don't mix
Object-level storage poised to replace NAS in the enterprise
Nine reasons object-level storage adoption has increased
RAID
RAID - Wikiwand
Standard RAID levels - Wikiwand
Nested RAID levels - Wikiwand
RAID - ArchWiki
What is RAID 0, 1, 5, & 10? - YouTube
RAID levels and benefits explained
Understanding RAID Performance at Various Levels - StorageCraft !important
Which Type of RAID Should You Use For Your Servers?
Hardware Raid is Dead and is a Bad Idea in 2022 - YouTube
Why RAID 5 stops working in 2009 | ZDNet
Why RAID 6 stops working in 2019 | ZDNet
RAID 5 or RAID 6: Which should you select? - TechRepublic
RAID 5 and RAID 6 - RAID Types Utilizing Parity
RAID 5 or RAID 6: Which should you select? - TechRepublic
RAID 5 vs RAID 10: Recommended RAID For Safety and Performance - nixCraft
RAID6 or RAID10 - Synology Forum
RAID 6 or RAID 1+0: Which should you choose? - TechRepublic
RAID 6 vs. RAID 10
Free RAID Calculator - Caclulate RAID Array Capacity and Fault Tolerance.
| RAID level | Min. HDD # | Capacity | Description |
|---|---|---|---|
| 0 | 2 | N | striped volume, increase performance |
| 1 | 2 | N/2 | mirror, provides redundancy |
| 5 | 3 | N-1 | 1 parity (single disk failure) |
| 6 | 4 | N-2 | 2 parity (two disks failure) |
Write-intent bitmap - Linux Raid Wiki for faster rebuild/recovery
Five ways to control RAID rebuild times
The RAID rebuild process and its impact on customers
RAID rebuilds: How do RAID rebuilds work and which is fastest?
5 Tips To Speed Up Linux Software Raid Rebuilding And Re-syncing - nixCraft
RAID 0、RAID 10、Single 和 JBOD 組態不支援儲存池之擴充
Unraid | Unleash Your Hardware
LUN
What is logical unit number (LUN)? - Definition from WhatIs.com SCSI identifier for a drive, partition, or RAID array
LUN storage and its role in SAN management
What is a LUN and why do we need storage LUNs?
What is a LUN and why do we need one?
The mystery behind LUN(Logical Unit Number) | Unixbhaskar's Blog
Modern NAS appliances can provide unified storage (block + file)
Dell
Dell PS (Equallogic) (stopped) & SC (Compellent)
Dell EMC Smart IT - Kinetic Infrastructure Webinar
Dynamic RAID with granular pages (not whole volume)
Dell EMC SC Series Hybrid Storage Arrays
Dell EMC SC All-flash Storage Arrays
QNAP
Tutorial - QNAP
QNAPedia
FAQ - QNAP
QNAP Helpdesk -
NAS User Manual
QNAP Systems, Inc. - YouTube
QTS 4.3.5 preview: Enhance your storage to maximize performance - YouTube
Qnap Advanced Support | Advanced Qnap Technical Support
QNAP NAS - Elvanör's Technical Wiki
TS-EC1680U - Features - QNAP dpms-nas1, dpms-nas2
- Core i3-4150 (E3-1200 v3?) 3.5GHz
- 8GB RAM
- 3U rack server
- 16 x 3.5" SATA 6Gb/s
- 2 x internal mSATA cache ports
TS-859U-RP+ msa-nas1
- Atom D525 1.80 GHz
- 1GB RAM
- 2U rack server
- 8 x 3.5" SATA 3Gb/s
TS-869U-RP - Features - QNAP msa-nas2
- Atom D2701 2.13 GHz
- 2GB RAM
- 2U rack server
- 8 x 3.5" SATA 6Gb/s
Expansion Units - QNAP
EJ Series Expansion Units
REXP Series Expansion Units
UX Series Expansion Units
Issues:
Extend storage
Connection between EC1680U and Expansion Unit
Data-in-place upgrade? Migrate disk to Expansion Units?
need flexible config
- all disks in single RAID turns out not a good choice
- can only add drives, not remove
- all drives must be of same capacity
- long rebuild time
Virtualized storage systems (use a much higher number of drives in the volume group) decreases rebuild time and load?
50 RAID, JBOD, storage pool
de-duplication
App store
App Center :: QNAP
Qnapclub Store
Common configs
/etc/config/uLinux.conf
/etc/exports
/etc/smb.confEnable NFSv4
NFSv4 support is behind a flag, to enable it:
/sbin/setcfg NFS Enable_V4 TRUE
/etc/init.d/nfs restartUbuntu client probably need this:
echo "NEED_IDMAPD=yes" >> /etc/default/nfs-commonFile System Check
Check File System returned "Examination failed (Cannot unmount disk)." - QNAP NAS Community Forum
# check file locks
lsof -n /dev/mapper/cachedev1
lsof +f -- /dev/mapper/cachedev1
/etc/init.d/services.sh stop
/etc/init.d/opentftp.sh stop
/etc/init.d/Qthttpd.sh stop
umount /dev/mapper/cachedev1
e2fsck_64 -f -v -C 0 /dev/mapper/cachedev1
mount /dev/mapper/cachedev1
reboot