{"id":4825,"date":"2010-08-07T10:31:18","date_gmt":"2010-08-07T10:31:18","guid":{"rendered":"http:\/\/www.hbyconsultancy.com\/?p=4825"},"modified":"2010-08-07T10:31:18","modified_gmt":"2010-08-07T10:31:18","slug":"shared-ocfs2-partition-on-ubuntu-server-10-04-x64","status":"publish","type":"post","link":"https:\/\/hbyconsultancy.com\/2010\/08\/shared-ocfs2-partition-on-ubuntu-server-10-04-x64.html","title":{"rendered":"Shared OCFS2 partition on Ubuntu Server 10.04 x64"},"content":{"rendered":"<p>One of the applications that I\u2019m working on uses archived documents, there is no NoSQL here, just plain tiff files with indexes in Oracle database. Everything related to document access, permissions, conversions, watermarking, security, encryption \u2026 is managed by the application itself. So I had to keep <a href=\"http:\/\/www.hbyconsultancy.com\/2010\/08\/two-nodes-load-balance-and-failover-with-keepalived-and-ubuntu-server-10-04-x64.html\">my cluster<\/a> permanently connected to a SAN storage via HBA fiber cards.<\/p>\n<p>In the beginning I opted for NFS as shared file system, then decided to go for <a href=\"http:\/\/oss.oracle.com\/projects\/ocfs2\/\">OCFS2<\/a> which is open source, maintained by Oracle, and available under GPLv2.<\/p>\n<p>Some Pros\/Cons of NFS, GFS2 and OCFS2 (from <a href=\"http:\/\/www.gpaterno.com\/publications\/2010\/dublin_ossbarcamp_2010_fs_comparison.pdf\">Dublin OSS barcamp<\/a>) :<\/p>\n<p><strong>NFS<\/strong><\/p>\n<ul>\n<li>Pro: standard, cross-platform, easy to implement<\/li>\n<li>Con: Poor performance, single point of failure (single locking manager, even in HA)<\/li>\n<\/ul>\n<p><strong>GFS2<\/strong><\/p>\n<ul>\n<li>Pro: Very responsive on large data files, works on physical and virtual, quota and SE-Linux support, faster than EXT3 when I\/O operations are on the same node<\/li>\n<li>Con: Only supported with Red Hat, Performance issues on accessing small files on several subdirectory on different nodes<\/li>\n<\/ul>\n<p><strong>OCFS2<\/strong><\/p>\n<ul>\n<li>Pro: Very fast with large and small data files on different node with two types of performance models (mail, data file). Works on a physical and virtual.<\/li>\n<li>Con: Supported only through contract with Oracle or SLES, no quota support, no on-line resize<\/li>\n<\/ul>\n<p>First we need to install OCFS2 tools :<\/p>\n<p><code>sudo apt-get install ocfs2-tools<\/code><\/p>\n<p>There is another package ocfs2console that you want to install to configure the cluster via GUI, but since I\u2019m using ubuntu server I\u2019m skipping this to configure my cluster manually.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-4826 aligncenter\" src=\"https:\/\/i0.wp.com\/wordpress-948180-3301344.cloudwaysapps.com\/wp-content\/uploads\/2014\/12\/CFS2Console-300x192-1.png?resize=300%2C192&#038;ssl=1\" alt=\"CFS2Console-300x192\" width=\"300\" height=\"192\" data-recalc-dims=\"1\" \/><\/p>\n<p>&nbsp;<\/p>\n<p>Create on every node attached to storage \/etc\/ocfs2\/cluster.conf<\/p>\n<p><code>sudo vi \/etc\/ocfs2\/cluster.conf<\/code><\/p>\n<p>With the content below, only replace node1 and node2 with their respective names and IP for each node :<\/p>\n<p><code>node:<br \/>\nname = node1<br \/>\ncluster = ocfs2<br \/>\nnumber = 0<br \/>\nip_address = 10.10.0.0<br \/>\nip_port = 7777<br \/>\nnode:<br \/>\nname = node2<br \/>\ncluster = ocfs2<br \/>\nnumber = 1<br \/>\nip_address = 10.10.0.1<br \/>\nip_port = 7777<br \/>\ncluster:<br \/>\nname = ocfs2<br \/>\nnode_count = 2<\/code><\/p>\n<p>Now you reconfigure ocfs2-tools with the default values :<\/p>\n<p><code>sudo dpkg-reconfigure ocfs2-tools<\/code><\/p>\n<p>then restart services :<\/p>\n<p><code>sudo \/etc\/init.d\/o2cb restart<br \/>\nsudo \/etc\/init.d\/ocfs2 restart<\/code><\/p>\n<p>If your fiber card connected to your host\/storage, and virtual disks created and presented you should run fdisk to see it :<\/p>\n<p><code>$ sudo fdisk -l<br \/>\nDisk \/dev\/sda: 1073.7 GB, 1073741824000 bytes<br \/>\n255 heads, 63 sectors\/track, 130541 cylinders<br \/>\nUnits = cylinders of 16065 * 512 = 8225280 bytes<br \/>\nSector size (logical\/physical): 512 bytes \/ 512 bytes<br \/>\nI\/O size (minimum\/optimal): 512 bytes \/ 512 bytes<br \/>\nDisk identifier: 0x02020202<\/code><\/p>\n<p>the result have been truncated to show only one virtual disk, and you might see multiple \/dev\/sda, \/dev\/sdb, \/dev\/sdc\u2026 according to your configuration in addition to your local hard disks. What I have done is creating a 1TB partition that I will share between my two nodes :<\/p>\n<p><code>$ sudo fdisk \/dev\/sda<\/code><\/p>\n<p>In fdisk menu choose \u201cn\u201d for new partition, and choose your partition size according to your requirements. Then use \u201cw\u201d to write changes and exit.<\/p>\n<p>Finally we create a ocfs2 partition table :<\/p>\n<p><code>$ mkfs.ocfs2 \/dev\/sda<\/code><\/p>\n<p>mount your partition :<\/p>\n<p><code>$ sudo mkdir \/archives<br \/>\n$sudo mount -t ocfs2 \/dev\/sda \/archives<\/code><\/p>\n<p>or you can add it to fstab to mount automatically on boot :<\/p>\n<p><code>$ \/dev\/sda \/archives ocfs2 _netdev 0 0<\/code><\/p>\n<p>The _netdev option is used here to prevent the system from attempting to mount these file systems until the network has been enabled on the system.<\/p>\n<p>You want to test your new partition, and you will notice that every file\/folder created on node1 is automatically available on node2, and vise-versa.<\/p>\n<p>Enjoy !<\/p>\n","protected":false},"excerpt":{"rendered":"<p>One of the applications that I\u2019m working on uses archived documents, there is no NoSQL here, just plain tiff files with indexes in Oracle database. Everything related to document access, permissions, conversions, watermarking, security, encryption \u2026 is managed by the application itself. So I had to keep my cluster permanently connected to a SAN storage [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[47,107,116,171,173,185,219,222,261],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/hbyconsultancy.com\/wp-json\/wp\/v2\/posts\/4825"}],"collection":[{"href":"https:\/\/hbyconsultancy.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hbyconsultancy.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hbyconsultancy.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/hbyconsultancy.com\/wp-json\/wp\/v2\/comments?post=4825"}],"version-history":[{"count":0,"href":"https:\/\/hbyconsultancy.com\/wp-json\/wp\/v2\/posts\/4825\/revisions"}],"wp:attachment":[{"href":"https:\/\/hbyconsultancy.com\/wp-json\/wp\/v2\/media?parent=4825"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hbyconsultancy.com\/wp-json\/wp\/v2\/categories?post=4825"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hbyconsultancy.com\/wp-json\/wp\/v2\/tags?post=4825"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}