{"id":166,"date":"2018-07-05T02:48:37","date_gmt":"2018-07-04T23:48:37","guid":{"rendered":"https:\/\/buraksuatgorgun.com.tr\/?p=166"},"modified":"2018-07-05T02:48:37","modified_gmt":"2018-07-04T23:48:37","slug":"ceph-storage-esxi-datastore-linux","status":"publish","type":"post","link":"https:\/\/www.buraksuatgorgun.com.tr\/index.php\/2018\/07\/05\/ceph-storage-esxi-datastore-linux\/","title":{"rendered":"CEPH Storage Kurulumu \/ Linux – ESXi ye Disk Eklenmesi"},"content":{"rendered":"

Ceph Storage Kurulum, Ubuntu, CentOS7 Mount ve ESXi Datastore olarak kullan\u0131m<\/strong><\/h3>\n

Merhaba Arkada\u015flar,<\/p>\n

Bu makalede Ceph Storage i\u00e7in kurulum prosed\u00fcrlerini ve \u00f6rnek bir ESXi sistemine datastore olarak nas\u0131l eklenece\u011fini i\u015fleyece\u011fiz.<\/p>\n

\u00d6ncelik ile Bu yap\u0131 i\u00e7in, en az 4 sunucu gereksinimimiz olacakt\u0131r. Bunlar;<\/p>\n

Admin \/ Deploy Node<\/p>\n

Monitor Node<\/p>\n

Storage Node 1<\/p>\n

Storage Node 2..<\/p>\n

Gibi olup, Her node ayr\u0131 bir sunucuyu belirtmektedir. Storage Node’lar\u0131 i\u00e7in ihtiyac\u0131n\u0131z ne ise o \u015fekilde d\u00fczenleyebilir, ek sunucular kurabilir yahut \u00e7al\u0131\u015fan yap\u0131ya ihtiyac\u0131n\u0131z oldu\u011funda rahatl\u0131kla yeni Storage Node’u ekleyebilirsiniz.<\/p>\n

Anlat\u0131mlarda 4 sunucunun da halihaz\u0131rda kurulu ve SSH’\u0131n aktif oldu\u011funu varsayarak ilerleyece\u011fim.<\/p>\n

\u00d6n Ayarlar<\/strong><\/h4>\n

Her\u015feyden \u00f6nce, OS diskiniz ve Ceph Storage \u00fczerinde kullan\u0131ma sunmay\u0131 planlad\u0131\u011f\u0131n\u0131z diskin ayr\u0131 olmas\u0131 gerekdi\u011fini belirtmek isterim. OS diskindeki alan kullan\u0131mda olmayacakt\u0131r. Kullan\u0131ma sunmay\u0131 planlad\u0131\u011f\u0131n\u0131z Storage diskinde ise hi\u00e7bir veri olmamal\u0131d\u0131r.<\/p>\n

\u0130lk olarak Admin \/ Deploy Node’unun kurulumunu ger\u00e7ekle\u015ftiriyoruz.<\/p>\n

Ben kurulumlarda Ubuntu 16.04.4 kulland\u0131m ancak ihtiyac\u0131n\u0131za g\u00f6re OpenSUSE yahut RHEL\/CentOS ta kullanabilirsiniz. Anlat\u0131m Ubuntu \u00fczerinden olacakt\u0131r,<\/p>\n

\u00d6ncelik ile Ceph Release key’i ekliyoruz;<\/p>\n

wget<\/span> -<\/span>q<\/span> -<\/span>O<\/span>-<\/span> 'https:\/\/download.ceph.com\/keys\/release.asc'<\/span> |<\/span> sudo<\/span> apt<\/span>-<\/span>key<\/span> add<\/span> -<\/span><\/pre>\n
Ard\u0131ndan, repomuza Ceph paketlerini ekliyoruz.<\/p>\n
echo deb https:\/\/download.ceph.com\/debian-{ceph-stable-release}\/ $(lsb_release -sc) main | sudo tee \/etc\/apt\/sources.list.d\/ceph.list<\/pre>\n
Ard\u0131ndan repomuzu update ederek ceph-deploy kurulumu ger\u00e7ekle\u015ftiriyoruz.<\/p>\n
sudo<\/span> apt<\/span> update<\/span>\nsudo<\/span> apt<\/span> install<\/span> ceph<\/span>-<\/span>deploy<\/span><\/pre>\n
Bu i\u015flemler ile Admin \/ Deploy nodunun ilk kurulumunu tamamlam\u0131\u015f olduk.<\/p>\n
NOT: Secure Linux (Selinux) aktif ise mutlaka devred\u0131\u015f\u0131 b\u0131rakmal\u0131s\u0131n\u0131z. (Ubuntu \u00fczerinde system utils kurmad\u0131 iseniz otomatik disable gelir.)
\nNOT: Seknronizasyon sorunu ya\u015fanmamas\u0131 i\u00e7in T\u00fcm node’lara ntp server kurulumunu ihmal etmemeniz gerekiyor.<\/p>\n
apt<\/span> install<\/span> ntp\n\/etc\/init.d\/ntp start\n<\/span><\/pre>\n
Bu a\u015famada \u00f6ncelik ile, Admin \/ Deploy Node’unun sunuculara hostname ile eri\u015febilmesi laz\u0131m.<\/p>\n
Ben node’lara,<\/p>\n
Admin Node – ceph<\/p>\n
Monitor Node – monitor<\/p>\n
Storage Node 1 – node1<\/p>\n
Storage Node 2 – node2<\/p>\n
\u015eeklinde Hostname tan\u0131mlad\u0131m.<\/p>\n
Admin \/ Deploy nodu \u00fczerinde\u00a0\/etc\/hosts i\u00e7erisine girerek IP – Hostname \u015feklinde giriyoruz;<\/p>\n
93.187.202.212 monitor ceph.monitor
\n93.187.202.235 node1 ceph.node1
\n93.187.202.231 node2 ceph.node2<\/p>\n
Eri\u015fimi ping node1 diyerek test edebilirsiniz.<\/p>\n
Bu i\u015flemin ard\u0131ndan Monit\u00f6r ve Storage nodelar\u0131 \u00fczerinde Admin\/Deploy nodunun eri\u015fece\u011fi kullan\u0131c\u0131lar\u0131 olu\u015fturuyoruz ve \u015fifrelerini belirliyoruz.<\/p>\n
useradd -d \/home\/cephusr -m cephusr\npasswd cephusr<\/pre>\n
Ve \u0130lgili kullan\u0131c\u0131lar\u0131n sudo yetkisi oldu\u011funa emin oluyoruz. Sudo yetkisi kazand\u0131rmak i\u00e7in;<\/p>\n
echo \"cephusr ALL = (root) NOPASSWD:ALL\" | sudo tee \/etc\/sudoers.d\/cephusr\nsudo chmod 0440 \/etc\/sudoers.d\/cephusr<\/pre>\n
\u0130\u015flem ard\u0131ndan \u015eifresiz SSH eri\u015fimini bu kullan\u0131c\u0131lar i\u00e7in aktif etmemiz gerekecektir. ceph-deploy komutu \u015fifre girmez, bu y\u00fczden ssh key generate etmemiz gerekiyor.<\/p>\n
Admin nodunda ssh-keygen komutunu \u00e7al\u0131\u015ft\u0131r\u0131n.<\/p>\n
(passphrase bo\u015f b\u0131rak\u0131lacak)<\/p>\n
ssh<\/span>-<\/span>keygen<\/span>\n\nGenerating<\/span> public<\/span>\/<\/span>private<\/span> key<\/span> pair<\/span>.<\/span>\nEnter<\/span> file<\/span> in<\/span> which<\/span> to<\/span> save<\/span> the<\/span> key<\/span> (<\/span>\/<\/span>ceph<\/span>-<\/span>admin<\/span>\/.<\/span>ssh<\/span>\/<\/span>id_rsa<\/span>):<\/span>\nEnter<\/span> passphrase<\/span> (<\/span>empty<\/span> for<\/span> no<\/span> passphrase<\/span>):<\/span>\nEnter<\/span> same<\/span> passphrase<\/span> again<\/span>:<\/span>\nYour<\/span> identification<\/span> has<\/span> been<\/span> saved<\/span> in<\/span> \/<\/span>ceph<\/span>-<\/span>admin<\/span>\/.<\/span>ssh<\/span>\/<\/span>id_rsa<\/span>.<\/span>\nYour<\/span> public<\/span> key<\/span> has<\/span> been<\/span> saved<\/span> in<\/span> \/<\/span>ceph<\/span>-<\/span>admin<\/span>\/.<\/span>ssh<\/span>\/<\/span>id_rsa<\/span>.<\/span>pub<\/span>.<\/span><\/pre>\n
Ard\u0131ndan t\u00fcm Node’lara keyi y\u00fcklemeliyiz.<\/p>\n
ssh<\/span>-<\/span>copy<\/span>-<\/span>id<\/span> cephusr@node1<\/span>\nssh<\/span>-<\/span>copy<\/span>-<\/span>id<\/span> cephusr@node2<\/span>\nssh<\/span>-<\/span>copy<\/span>-<\/span>id<\/span> cephusr@monitor<\/span><\/pre>\n
\u015eifreleri soracakt\u0131r, \u015fifrelerini girmenizin ard\u0131ndan art\u0131k Admin nodu, t\u00fcm node lara ssh \u00fczerinden \u015fifre gereksinimi olmadan eri\u015fim sa\u011flayabilecektir.<\/p>\n
Kontrol i\u00e7in;<\/p>\n
ssh cephusr@monitor<\/p>\n
Komutunu kullanabilir, eri\u015febildi\u011fini do\u011frulayabilirsiniz.<\/p>\n
Bu i\u015flemin ard\u0131ndan ceph-deploy’un SSH ba\u011flant\u0131s\u0131nda cephusr kullan\u0131c\u0131s\u0131n\u0131 \u00e7al\u0131\u015ft\u0131rabilmesi i\u00e7in, Admin \/ Deploy Node \u00fczerinde config dosyas\u0131 olu\u015fturuyoruz;<\/p>\n
nano \/etc\/.ssh\/config<\/p>\n
Ve i\u00e7erisini a\u015fa\u011f\u0131daki \u015fekilde d\u00fczenliyoruz;<\/p>\n
Host<\/span> node1<\/span>\n   Hostname<\/span> node1<\/span>\n   User<\/span> {<\/span>username<\/span>}<\/span>\nHost<\/span> node2<\/span>\n   Hostname<\/span> node2<\/span>\n   User<\/span> {<\/span>username<\/span>}<\/span>\nHost<\/span> node3<\/span>\n   Hostname<\/span> node3<\/span>\n   User<\/span> {<\/span>username<\/span>}<\/span><\/pre>\n
Bu benim yap\u0131land\u0131rmam i\u00e7in a\u015fa\u011f\u0131daki \u015fekildedir;<\/p>\n
Host monitor\n  Hostname monitor\n  User cephusr\nHost node1\n  Hostname node1\n  User cephusr\nHost node2\n  Hostname node2\n  User cephusr<\/pre>\n
B\u00f6ylece d\u00fcz SSH ile ba\u011flanmak istedi\u011finde otomatik root a y\u00f6nlendirilmeyecek, cephusr kullan\u0131c\u0131s\u0131na y\u00f6nlendirilecektir.<\/p>\n
Bu i\u015flemler ile \u00f6n haz\u0131rl\u0131klar\u0131m\u0131z\u0131 tamamlam\u0131\u015f olduk. Art\u0131k konfig\u00fcrasyona ba\u015flayabiliriz.<\/p>\n
Storage Cluster yap\u0131s\u0131n\u0131n olu\u015fturulmas\u0131<\/strong><\/h4>\n
Admin nodu \u00fczerinde, ceph-deploy komutunun otomatik olu\u015fturdu\u011fu konfig\u00fcrasyon dosyalar\u0131 ve keylerin tutulmas\u0131 i\u00e7in bir klas\u00f6r olu\u015fturuyoruz.<\/p>\n
mkdir<\/span> my<\/span>-<\/span>cluster<\/span>\ncd<\/span> my<\/span>-<\/span>cluster<\/span><\/pre>\n
NOT: ceph-deploy komutu, \u00e7\u0131kt\u0131y\u0131 bulundu\u011fu klas\u00f6re aktaraca\u011f\u0131 i\u00e7in kullan\u0131rken daima my-cluster klas\u00f6r\u00fcnde yahut siz cluster ad\u0131n\u0131 ne \u015fekilde belirledi iseniz, o klas\u00f6rde olmal\u0131s\u0131n\u0131z.<\/p>\n
NOT: Ba\u015fka bir kullan\u0131c\u0131 ile giri\u015f yapm\u0131\u015f iken sudo kullanmamal\u0131s\u0131n\u0131z.<\/p>\n
Art\u0131k Cluster olu\u015fturma i\u015flemine ba\u015flayabiliriz.<\/p>\n
Test i\u00e7in ufak bir journal olu\u015fturarak devam ediyoruz.<\/p>\n
\/my-cluster\/ceph.conf i\u00e7erisinde, en alta;<\/p>\n
[osd]\nosd_journal_size = 2000<\/code><\/pre>\n
\u015eeklinde ekliyoruz.<\/p>\n
Deploy i\u015fleminden sonra Journal olu\u015fmu\u015f olmal\u0131. E\u011fer herhangi bir hata al\u0131yor iseniz conf dosyas\u0131nda yahut kurulumda yanl\u0131\u015fl\u0131k ger\u00e7ekle\u015ftirmi\u015f olmal\u0131s\u0131n\u0131z, tekrar kontrol etmeniz gerekmektedir.<\/p>\n
\u015eimdi deploy i\u015flemini my-cluster klas\u00f6r\u00fc i\u00e7erisinde iken ger\u00e7ekle\u015ftirerek cluster’i olu\u015ftural\u0131m;<\/p>\n
ceph<\/span>-<\/span>deploy<\/span> new<\/span> monitor node1 node2<\/pre>\n
Ben \u015fahsen a\u015fa\u011f\u0131daki hatay\u0131 ald\u0131m;<\/p>\n
bash: python: command not found
\n[ceph_deploy][ERROR ] RuntimeError: connecting to host: monitor resulted in errors: IOError cannot send (already closed?)<\/p>\n
Bunun sebebi de ceph-deploy’un phyton ile \u00e7al\u0131\u015fmas\u0131 ve sunucularda phyton bulunmamas\u0131d\u0131r.<\/p>\n
T\u00fcm sunuculara a\u015fa\u011f\u0131daki komut ile phyton kurulumu ger\u00e7ekle\u015ftiriyoruz;<\/p>\n
sudo apt install python-minimal<\/p>\n
Bu i\u015flemin ard\u0131ndan ceph-deploy new nodex nodex nodex komutunu tekrar uyguluyoruz. Sorunsuzca tamamlanm\u0131\u015f olmal\u0131.<\/p>\n
Ard\u0131ndan node’lar \u00fczerine kurulumu sa\u011fl\u0131yoruz;<\/p>\n
ceph<\/span>-<\/span>deploy<\/span> install<\/span> node1<\/span> node2<\/span> node3<\/span><\/pre>\n
\u0130\u015flem tamamland\u0131\u011f\u0131nda Ceph, her node’a kurulmu\u015f olacakt\u0131r.<\/p>\n
Ard\u0131ndan monit\u00f6r sistemi i\u00e7in \u00f6n haz\u0131rl\u0131k yap\u0131yoruz,<\/p>\n
ceph<\/span>-<\/span>deploy<\/span> mon<\/span> create<\/span>-<\/span>initial<\/span><\/pre>\n
Bu komut keyleri toplayacakt\u0131r ve my-cluster klas\u00f6r\u00fcn\u00fczde;<\/p>\n