<?xml version="1.0" encoding="utf-8" ?>

<rss version="2.0" 
   xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"
   xmlns:admin="http://webns.net/mvcb/"
   xmlns:dc="http://purl.org/dc/elements/1.1/"
   xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
   xmlns:wfw="http://wellformedweb.org/CommentAPI/"
   xmlns:content="http://purl.org/rss/1.0/modules/content/"
   >
<channel>
    
    <title>Raymond P. Burkholder - Things I Do - Ceph</title>
    <link>https://blog.raymond.burkholder.net/</link>
    <description>In And Around Technology and The Arts</description>
    <dc:language>en</dc:language>
    <generator>Serendipity 1.7.2 - http://www.s9y.org/</generator>
    <pubDate>Wed, 13 Apr 2022 18:45:57 GMT</pubDate>

    <image>
        <url>https://blog.raymond.burkholder.net/templates/bulletproof/img/s9y_banner_small.png</url>
        <title>RSS: Raymond P. Burkholder - Things I Do - Ceph - In And Around Technology and The Arts</title>
        <link>https://blog.raymond.burkholder.net/</link>
        <width>100</width>
        <height>21</height>
    </image>

<item>
    <title>Dell R610 with H310 Drive Controller</title>
    <link>https://blog.raymond.burkholder.net/index.php?/archives/1059-Dell-R610-with-H310-Drive-Controller.html</link>
            <category>Ceph</category>
    
    <comments>https://blog.raymond.burkholder.net/index.php?/archives/1059-Dell-R610-with-H310-Drive-Controller.html#comments</comments>
    <wfw:comment>https://blog.raymond.burkholder.net/wfwcomment.php?cid=1059</wfw:comment>

    <slash:comments>0</slash:comments>
    <wfw:commentRss>https://blog.raymond.burkholder.net/rss.php?version=2.0&amp;type=comments&amp;cid=1059</wfw:commentRss>
    

    <author>nospam@example.com (Raymond P. Burkholder)</author>
    <content:encoded>
    &lt;p&gt;When using some relatively inexpensive parts to build a test three server Ceph solution, it seems that drive controllers and SSD drive combinations are finicky.  Specifically, it seems that a Dell H310 controller may have issues with some or all Samsung SSD drives. 

&lt;p&gt;At &lt;a href=&quot;https://www.dell.com/community/PowerEdge-HDD-SCSI-RAID/Slow-writes-PERC-H700-and-Samsung-850-PRO-SSD/td-p/5007559&quot; target=_blank&gt;Slow writes PERC H700 and Samsung 850 PRO SSD&lt;/a&gt;, a Dell response indicates:

&lt;blockquote&gt;
The  Samsung 850 Pro SSDs are not validated or certified to work with Dell controllers and as such there is a communication mismatch between the drives and the controller at the firmware level. As a result, you are bound to realize unexpected poor Read and Write performance regardless of controller cache settings.
&lt;/blockquote&gt;

&lt;p&gt;It said that the Samsung 840 drive will work with the controllers.  With Broadcom taking over LSI, they&#039;ve removed old links, so documents are hard to find now.  In trying to follow a document trail:

&lt;ul&gt;
  &lt;li&gt;&lt;a href=&quot;https://downloads.dell.com/manuals/common/rc_h310_h710_h710p_h810_ug_en-us.pdf&quot; target=_blank&gt;Dell PowerEdge RAID Controller (PERC) H310, H710, H710P, and H810User’s Guide&lt;/a&gt; on page 9 says the H310 has an LSI2008 chipset.   I&#039;m looking at the H310 as it provides for direct passthrough to the drives with out RAID.  The card has no caching.
  &lt;li&gt;&lt;a href=&quot;https://www.servethehome.com/lsi-sas-2008-raid-controller-hba-information/&quot; target=-blank&gt;LSI SAS 2008 RAID Controller/ HBA Information&lt;/a&gt; - An H310 is similar to the LSI9211-8i
  &lt;li&gt;&lt;a href=&quot;https://www.broadcom.com/support/storage/interop-compatibility&quot; target=_blank&gt;Check Interoperability and Compatibility&lt;/a&gt;
  &lt;/ul&gt;

&lt;p&gt;To use the H310 for non-cache passthrough, it is recommended to flash the card in IT mode.  I&#039;ll try this once I obtain the card.  In the meantime, some possibly relevant links to the drivers and process:

&lt;ul&gt;
  &lt;li&gt;&lt;a href=&quot;http://www.yellow-bricks.com/2014/04/17/disk-controller-features-and-queue-depth/&quot; target=_blank&gt;Disk Controller features and Queue Depth?&lt;/a&gt; - from 2014, discusses queue depth and diagnostic commands.
  &lt;li&gt;&lt;a href=&quot;https://www.reddit.com/r/homelab/comments/bkxszi/flashing_the_h310_mono_mini_to_it_mode/&quot; target=_blank&gt;Flashing the H310 Mono Mini to IT mode&lt;/a&gt; has a link to probably the 
&lt;a href=&quot;https://phoxden.net/H310MM_IT.pdf&quot; target=_blank&gt;best link&lt;/a&gt; to a flashing tutorial.  But is complicated for flashing the mini H310.  From the notes:  the R610 is an 11th generation server, and when the mini H310 is reflashed to IT mode, the server probably won&#039;t reboot.
  &lt;li&gt;&lt;a href=&quot;https://www.ttl.one/2018/02/upgrade-dell-perc-h200h310-easy-way.html&quot; target=_blank&gt; Crossflashing the Dell PERC H200 and H310 to the LSI 9211-8i&lt;/a&gt; (from year 2018) implies that the H310 is the equivalent of an LSI 9211-8i.  Also, a Dell H200 and an H310 must be similar from a firmware perspective.
  &lt;li&gt;&lt;a href=&quot;http://brycv.com/blog/2012/flashing-it-firmware-to-lsi-sas9211-8i/&quot; target=_blank&gt;Flashing IT Firmware to the LSI SAS9211-8i HBA&lt;/a&gt; - 2012 - flash to a pci card
  &lt;li&gt;&lt;a href=&quot;https://tylermade.net/2017/06/27/how-to-crossflash-perc-h310-to-it-mode-lsi-9211-8i-firmware-hba-for-freenas-unraid/&quot; target=_blank&gt;How to crossflash PERC H310 to IT mode LSI 9211-8i firmware (HBA for FreeNAS, UnRAID)&lt;/a&gt; - an article from 2017 with better, more native instructions
  &lt;li&gt;&lt;a href=&quot;https://jc-lan.org/2018/05/19/flash-dell-perc-h310-to-lsi-9211-8i-it-mode-using-bios-and-uefi-method-firmware-bios/&quot; target=_blank&gt;Crossflash Dell PERC H310 to LSI 9211-8i IT Mode Using Legacy (DOS) and UEFI Method (HBA Firmware + BIOS)&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;https://forums.servethehome.com/index.php?threads/perc-h310-lsi-9211-8i-50.4540/&quot; target=_blank&gt;PERC H310 - LSI 9211-8i - $50&lt;/a&gt; - notes on purchase, install, and upgrade of card.
  &lt;li&gt;&lt;a href=&quot;https://forums.servethehome.com/index.php?threads/problems-flashing-dell-perc-h310.26596/&quot; target=_blank&gt;Problems Flashing Dell Perc H310&lt;/a&gt; - discusses H310 in PCI slot instead
  &lt;li&gt;&lt;a href=&quot;https://www.vladan.fr/flash-dell-perc-h310-with-it-firmware/&quot; target=_blank&gt;How-to Flash Dell Perc H310 with IT Firmware To Change Queue Depth from 25 to 600&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;https://techmattr.wordpress.com/2016/04/11/updated-sas-hba-crossflashing-or-flashing-to-it-mode-dell-perc-h200-and-h310/&quot; target=_blank&gt;Updated: SAS HBA crossflashing or flashing to IT mode, Dell Perc H200 and H310&lt;/a&gt; from 2016 where is is suggested that &quot;Integrated, Mini or Mini Mono Perc H310 do NOT try to crossflash with these steps&quot;.
  &lt;li&gt;&lt;a href=&quot;https://www.dell.com/support/home/us/en/04/drivers/driversdetails?driverid=hm7mn&quot; target=_blank&gt;DELL PERC H310/H710/H710P/H810 Controllers driver version 5.1.112.64,A00&lt;/a&gt; - a starting point for the search of appropriate drivers
  &lt;li&gt;&lt;a href=&quot;https://www.dell.com/support/home/us/en/04/drivers/driversdetails?driverid=52r3d&quot; target=_blank&gt;LINUX PERCCLI Utility For All Dell HBA/PERC Controllers&lt;/a&gt; - and the starting point for command line utilities
  &lt;li&gt;&lt;a href=&quot;https://hwraid.le-vert.net/wiki/LSIMegaRAIDSAS&quot; target=_blank&gt;LSI MegaRAID SAS&lt;/a&gt; - some notes on the CLI utilities
  &lt;li&gt;&lt;a href=&quot;https://www.mindwerks.net/2012/06/doing-battle-with-a-dell-r620-and-ubuntu/&quot; target=_blank&gt;Doing battle with a Dell R620 and Ubuntu&lt;/a&gt; - has some remarks on H310 testing.
  &lt;li&gt;&lt;a href=&quot;https://forums.servethehome.com/index.php?threads/half-decent-all-in-one-build.7423/#post-66375&quot; target=_blank&gt;H310 and Fan Noise&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;https://us.community.samsung.com/t5/Monitors-and-Memory/Low-random-read-write-on-samsung-840-250gb-ssd/td-p/265356&quot; target=_blank&gt;Low random read/write on samsung 840 250gb ssd &lt;/a&gt; - spectre bios upgrades can destroy random read/write times
  &lt;/ul&gt;

&lt;p&gt;Drive Information:

&lt;ul&gt;
  &lt;li&gt;&lt;a href=&quot;https://techcommunity.microsoft.com/t5/storage-at-microsoft/don-t-do-it-consumer-grade-solid-state-drives-ssd-in-storage/ba-p/425914#&quot; target=_blank&gt;Don&#039;t do it: consumer-grade solid-state drives (SSD) in Storage Spaces Direct &lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;https://www.sebastien-han.fr/blog/2014/10/10/ceph-how-to-test-if-your-ssd-is-suitable-as-a-journal-device/&quot; target=_blank&gt;Ceph: how to test if your SSD is suitable as a journal device?&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;https://www.samsung.com/semiconductor/global.semi.static/High-Performance_Red_Hat_Ceph_Storage_Using_Samsung_NVMe_SSDs_WP_20161006-0.pdf&quot; target=_blank&gt;High-performance cluster storage for IOPS-intensive workloads&lt;/a&gt;
  &lt;/ul&gt;

&lt;p&gt;Cluster test:
&lt;blockquote&gt;
rados bench -p vm_storage 10 write -b 4M -t 16&quot;
&lt;/blockquote&gt;

&lt;p&gt;2022/04/13 - challenges

&lt;p&gt;In a Dell R620, with an LSI SAS card, it took a while to find a utility to communicate with the card.  Over the fold are some results: &lt;br /&gt;&lt;a href=&quot;https://blog.raymond.burkholder.net/index.php?/archives/1059-Dell-R610-with-H310-Drive-Controller.html#extended&quot;&gt;Continue reading &quot;Dell R610 with H310 Drive Controller&quot;&lt;/a&gt;
    </content:encoded>

    <pubDate>Thu, 26 Mar 2020 18:01:33 +0000</pubDate>
    <guid isPermaLink="false">https://blog.raymond.burkholder.net/index.php?/archives/1059-guid.html</guid>
    
</item>
<item>
    <title>Ceph Stuff</title>
    <link>https://blog.raymond.burkholder.net/index.php?/archives/693-Ceph-Stuff.html</link>
            <category>Ceph</category>
    
    <comments>https://blog.raymond.burkholder.net/index.php?/archives/693-Ceph-Stuff.html#comments</comments>
    <wfw:comment>https://blog.raymond.burkholder.net/wfwcomment.php?cid=693</wfw:comment>

    <slash:comments>0</slash:comments>
    <wfw:commentRss>https://blog.raymond.burkholder.net/rss.php?version=2.0&amp;type=comments&amp;cid=693</wfw:commentRss>
    

    <author>nospam@example.com (Raymond P. Burkholder)</author>
    <content:encoded>
    &lt;p&gt;Some Ceph links on which I need to review:

&lt;ul&gt;
  &lt;li&gt;&lt;a href=&quot;https://www.hastexo.com/resources/hints-and-kinks/solid-state-drives-and-ceph-osd-journals&quot; target=_blank&gt;Solid-state drives and Ceph OSD journals&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;https://alanxelsys.com/ceph-hands-on-guide/&quot; target=_blank&gt;AJ&#039;s Data Storage Tutorials&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;https://arvimal.wordpress.com/category/ceph-2/&quot; target=_blank&gt;Sharding the Ceph RADOS Gateway bucket index&lt;/a&gt;: quite a few good Ceph articles
  &lt;li&gt;&lt;a href=&quot;https://arvimal.wordpress.com/2015/07/09/how-to-compact-a-ceph-monitor-store/&quot; target=_blank&gt;Compacting a Ceph monitor store&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;http://www.stratoscale.com/blog/storage/introduction-to-ceph/&quot; target=_blank&gt;Introduction to Ceph&lt;/a&gt;: from StratoScale
  &lt;li&gt;&lt;a href=&quot;http://www.admin-magazine.com/HPC/Articles/Getting-Ready-for-the-New-Ceph-Object-Store&quot; target=_blank&gt;Ceph Jewel&lt;/a&gt;: from Admin HPC Magazine, Jewel, with CephFS, as a file system, is ready prime time.
  &lt;li&gt;&lt;a href=&quot;http://arstechnica.com/civis/viewtopic.php?f=21&amp;t=1258949&quot; target=_blank&gt;Scale Out Storage Comparisons&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;http://ceph-users.ceph.narkive.com/xOfjm2ol/ssd-cache-tier-rbd-cache-filesystem-corruption&quot; target=_blank&gt;Use forward mode instead of writeback&lt;/a&gt;?
  &lt;li&gt;&lt;a href=&quot;http://www.slideshare.net/LarryCover/ceph-open-source-storage-software-optimizations-on-intel-architecture-for-cloud-workloads&quot; target=_blank&gt;Open Source Storage Software Optimizations on Intel® Architecture for Cloud Workloads &lt;/a&gt; on SlideShare
  &lt;li&gt;&lt;a href=&quot;https://forum.proxmox.com/threads/ceph-backup.19341/&quot; target=_blank&gt;Ceph Backup&lt;/a&gt;: blowing out the cache when backing up
  &lt;li&gt;&lt;a href=&quot;https://forum.proxmox.com/threads/flashcache-vs-cache-tiering-in-ceph.26050/&quot; target=_blank&gt;Flashcache vs Cache Tiering in Ceph&lt;/a&gt;: hints and don&#039;ts
  &lt;li&gt;&lt;a href=&quot;https://forum.proxmox.com/threads/tweaking-vzdump-with-ceph-backend.20692/&quot; target=_blank&gt;Tweaking VZDump with Ceph Backend&lt;/a&gt;:  might be solved by now
  &lt;li&gt;&lt;a href=&quot;https://01.org/node/3916&quot; target=_blank&gt;Performance Portal for Ceph&lt;/a&gt;: by Intel
  &lt;li&gt;&lt;a href=&quot;https://github.com/ceph/ceph-ansible&quot; target=_blank&gt;Ansible playbooks for Ceph&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;http://www.sebastien-han.fr/blog/2016/05/18/Using-Ubuntu-Planning-on-using-Ceph-Jewel-Here-what-you-should-consider/&quot; target=_blank&gt;Planning on using Ceph Jewel? Here what you should consider&lt;/a&gt;: lots of useful stuff on Sébastien Han&#039;s site
  &lt;li&gt;&lt;a href=&quot;http://www.virtualtothecore.com/en/adventures-ceph-storage-part-1-introduction/&quot; target=_blank&gt;My adventures with Ceph Storage. Part 1: Introduction&lt;/a&gt;
  &lt;li&gt;&lt;a href=&quot;https://www.linkedin.com/topic/ceph&quot; target=_blank&gt;LinkedIn: Ceph&lt;/a&gt;
  &lt;li&gt;2020/04/06 &lt;a href=&quot;https://pages.croit.io/croit/v2002/getting-started/installation.html&quot; target=_blank&gt;croit Ceph Storage Management Software&lt;/a&gt;
  &lt;/ul&gt; 
    </content:encoded>

    <pubDate>Tue, 25 Oct 2016 16:17:37 +0000</pubDate>
    <guid isPermaLink="false">https://blog.raymond.burkholder.net/index.php?/archives/693-guid.html</guid>
    
</item>

</channel>
</rss>
