Ova stranica opisuje postupak koji prolaze podaci da bi novootvoreni korisnici preko Koha sučelja
a) dobili članski broj (broj kartice)
b) pojavili se u SafeQ sustavu.

SafeQ sustav povlači podatke o korisnicima iz Kohe preko LDAP-a. LDAP je implementiran direktno na podacima u Kohi (vidi SafeQ integration), ali SafeQ ne može pročitati broj korisnika sa kartice, nego samo serijski broj kartice koji koristi RFID protokol (SID).

Taj broj postoji jedino u log datotekama 3M sustava, a kako računalo na kojem se programiraju čipovi za sad nije spojeno na mrežu, cijela procedura ipak ovisi o povremenom presnimavanju podataka na server.

U razvoju je zamjena za cijelu ovu proceduru koja bi omogućila printanje novih isprogramiranih kartica odmah nakon što se korisnik prvi puta ulogira u Kohu (tj. odmah čim aktivira članstvo u knjižnici).

trenutno stanje

Generiranje brojeva kartica

Prvi korak je dodjeljivanje brojeva kartica u obliku 200908240042 gdje su prve znamenke datum a zadnje četiri redni broj korisnika u tom danu. To je jedinstveni broj korisnika koji koriste svi ostali servisi (npr. 3M Selfcheck) ali ne i SafeQ-a!

Generiranje brojeva kartica

ovaj korak radi se na produkcijskoj bazi

dpavlin@koha:/srv/koha-rfid$ ./generate-cardnumber.pl --commit

provjeriti ispis i pokrenuti ponovo sa --commit da bi se promjene zapisale u bazu

generira također backup borrowers tablice

Ispisuje na kraju generirato ime log datoteke:

backup for borrowers table: backup/borrowers.2010-09-02T15:05:09.sql 3838484 bytes
generated print.2010-09-02T15:05:09.txt 41879 bytes

Format loga: cardnumber <tab> login <tab> ime <tab> prezime

dpavlin@klin:~/klin/Biblio-RFID$ head -1 print.2010-09-02T15\:05\:09.txt 
201007140004    kohatest@ffzg.hr        Koha    Testičić Probišić Đž

Printanje iskaznica

ovaj korak se radi na mašini sa koje se printaju iskaznice

Podaci za pritanje

dpavlin@klin:~/klin/Biblio-RFID$ rsync -v koha:/srv/koha-rfid/print*.*.txt .

Pokretanje printanja

Printanje čeka da se kartica makne na RFID čitača da bi nastavilo!

dpavlin@klin:~/klin/Biblio-RFID$ ./scripts/print.pl print.2010-09-02T15\:05\:09.txt

...

QUEUE EMPTY - printing finished
log.print/2010-08-17T16:36:27.txt 100 bytes created

Kopiranje SID-ova za Kohu

dpavlin@klin:~/klin/Biblio-RFID$ rsync -rav log.print/ koha.ffzg.hr:/srv/koha-rfid/log.print/

Import SID-ova u Kohu

dpavlin@koha-dev:/srv/koha-rfid$ ./rfid2koha-borrower-attribute.pl log.print/2010-08-17T16\:36\:27.txt

Import 3M log datoteka

ovaj korak je stara procedura i ne koristi se više

kopiranje novih logova na koha-dev

*.LOG datoteke iz 3M softwarera se kopiraju u /srv/koha-rfid/log

dpavlin@koha:~$ sudo mount /mnt/koncar/
dpavlin@koha:~$ cp -v /mnt/koncar/* /srv/koha-rfid/log/
dpavlin@koha:~$ sudo umount /mnt/koncar/

preimenovanje u intervale koje pokrivaju

dpavlin@koha:/srv/koha-rfid$ make rename
find log/ -name "*.LOG" | xargs -i ./rename-log.sh {}
chmod 644 log/*.log

dpavlin@koha:/srv/koha-rfid$ ls -al log | head
total 27860
drwxr-xr-x 4 dpavlin dpavlin   4096 2010-03-01 16:33 .
drwxrwxr-x 6 dpavlin dpavlin   4096 2010-02-25 15:18 ..
-rw-r--r-- 1 dpavlin dpavlin 524488 2010-02-21 02:10 20080922-20081111.log
-rw-r--r-- 1 dpavlin dpavlin 524334 2010-02-21 02:10 20081015-20081024.log
-rw-r--r-- 1 dpavlin dpavlin 524606 2010-02-21 02:10 20081024-20081103.log
-rw-r--r-- 1 dpavlin dpavlin 524322 2010-02-21 02:10 20081027-20081027.log
-rw-r--r-- 1 dpavlin dpavlin 524510 2010-02-21 02:10 20081027-20081029.log
-rw-r--r-- 1 dpavlin dpavlin 524296 2010-02-21 02:10 20081029-20081103.log
-rw-r--r-- 1 dpavlin dpavlin 524366 2010-02-21 02:10 20081103-20081106.log

provjera novih podataka

cd log
git status
git add *.log
git commit -m 'new data'

parse log

dpavlin@koha-dev:/srv/koha-rfid$ make rfid

...

wc -l rfid.txt
12196 rfid.txt
echo "`cat rfid.txt | cut -d, -f2 | sort -u | wc -l` different tags"
11243 different tags
echo "`cat rfid.txt | cut -d, -f2- | grep ',20' | sort -u | wc -l` card tags"
4151 card tags

Kopiranje borrowers tablice s produkcije na development

dpavlin@koha-dev:/srv/koha-rfid$ ./update-borrowers.sh

Ovo će stvoriti borrowers2 tablicu na developmentu i prekopirati sve nove korisnike u borrowers tablicu, a postojećim korisnicima upisati cardnumber ako je on u međuvremenu generiran na produkciji.

update kohe

(pokreće sam i parsanje log dataoteka)

dpavlin@koha-dev:/srv/koha-rfid$ make rfid2koha

Ova stranica opisuje proceduru upgrade produkcijske Koha instalacije na koha.ffzg.hr na zadnju verziju iz našeg git-a

fix perms

dpavlin@koha-upgrade:/srv/koha$ sudo chgrp -R koha .
dpavlin@koha-upgrade:/srv/koha$ sudo chmod -R g+w .

upgrade

dpavlin@koha-upgrade:/srv/koha$ git pull
dpavlin@koha-upgrade:/srv/koha$ perl Makefile.PL

...

Please specify the password of the user that owns the 
database to be used by Koha [katikoan] 

...

prerequisite

[Wed Oct 28 18:35:13 2009] Makefile.PL: Warning: prerequisite IPC::Cmd 0.46 not found. We have 0.401.
[Wed Oct 28 18:35:13 2009] Makefile.PL: Warning: prerequisite Memoize::Memcached 0.03 not found.
[Wed Oct 28 18:35:14 2009] Makefile.PL: Warning: prerequisite Test::More 0.8 not found. We have 0.72.

dpavlin@koha-upgrade:/srv/koha$ sudo apt-get install -y libcache-memcached-perl libtest-mockobject-perl

dpavlin@koha-upgrade:/srv/koha$ sudo cpan IPC::Cmd Memoize::Memcached Test::More Authen::CAS::Client Lingua::Stem::Snowball

test

dpavlin@koha-upgrade:/srv/koha$ make test

...

All tests successful, 12 subtests skipped.
Files=25, Tests=391,  5 wallclock secs ( 4.71 cusr +  0.32 csys =  5.03 CPU)

upgrade

dpavlin@koha-upgrade:/srv/koha$ sudo make upgrade

...

Koha's files have now been installed.

In order to use Koha's command-line batch jobs,
you should set the following environment variables:

export KOHA_CONF=/etc/koha/koha-conf.xml
export PERL5LIB=/usr/share/koha/lib

For other post-installation tasks, please consult the README.

Upgrade ce iskopirati sve promijenjene fajlove i dodati im nastavak _upgrade_backup. To može biti korisno u slučaju kad su na produkciji rađene promjene koje nisu pospremljene u repozitorij (git).

Stvoreni fajlovi mogu se obrisati ovako:

find . -name '*_upgrade_backup' -exec rm -v {} \;

konfiguracija

dpavlin@koha-upgrade:/etc/koha$ sudo vi -d /etc/koha/koha-conf.xml /etc/koha/koha-conf.xml_upgrade_backup

LDAP config & start

dpavlin@koha-dev:/srv/koha$ grep VERSION /srv/koha/C4/Auth_with_ldap.pm 
use vars qw($VERSION @ISA @EXPORT @EXPORT_OK %EXPORT_TAGS $debug);
        $VERSION = 3.10;        # set the version for version checking

<ldapserver id="ldapserver" listenref="ldapserver">
<!--
 <hostname>ldaps://ldap.ffzg.hr</hostname>
-->
 <hostname>ldap://localhost:1389</hostname>
 <base>dc=ffzg,dc=hr</base>

 <replicate>1</replicate>  <!-- add new users from LDAP to Koha database -->
 <update>0</update>        <!-- update existing users in Koha database -->

 <auth_by_bind>1</auth_by_bind>
 <principal_name>%s</principal_name> <!-- optional, for auth_by_bind: a printf format to make userPrincipalName from koha userid -->

 <mapping>            <!-- match koha SQL field names to your LDAP record field names -->
    <firstname   is="givenname"     ></firstname>
    <surname     is="sn"            ></surname>
    <address     is="ffzg-ml_postanska_adresa_0" ></address>
<!--
    <city        is="ffzg-prebivaliste_mjesto" ></city>
-->
    <city        is="ffzg-ml_postanska_adresa_1" ></city>
    <zipcode     is="ffzg-prebivaliste_postanski_broj"></zipcode>

    <branchcode  is="local-branch"        >FFZG</branchcode>
    <userid      is="hredupersonuniqueid"  ></userid>
    <password    is="userpassword"  ></password>
    <email       is="mail"          ></email>
    <categorycode is="local-categorycode"  >IMP</categorycode>

    <dateofbirth is="ffzg-datum_rodjenja" ></dateofbirth>
    <sex is="ffzg-spol" ></sex>
    <phone is="ffzg-ml_telefoni_fixed"></phone>
    <mobile is="ffzg-ml_telefoni_mobile"></mobile>

 </mapping>
</ldapserver>

# tunnel
dpavlin@llin:~$ ssh -R 8022:localhost:22 10.60.0.252

dpavlin@koha-2010-01-06:~$ cd /srv/virtual-ldap/
dpavlin@koha-2010-01-06:/srv/virtual-ldap$ svn update
A    sql
A    sql/organizationalunit.sql
A    sql/group.sql
A    sql/hreduperson.sql
U    lib/LDAP/Virtual.pm
U    lib/LDAP/Koha.pm
U    bin/ldap-rewrite.pl
Updated to revision 61.

dpavlin@koha-upgrade:~$ screen -S virtual-ldap

dpavlin@koha-upgrade:~$ cd /srv/virtual-ldap/
dpavlin@koha-upgrade:/srv/virtual-ldap$ ./bin/virtual-ldap.pl 
LDAP server listening on port 1389

dpavlin@koha-upgrade:/srv/virtual-ldap$ ./bin/virtual-ldap.pl 
Can't locate Net/LDAP/Server.pm in @INC (@INC contains: lib /etc/perl /usr/local/lib/perl/5.10.0 /usr/local/share/perl/5.10.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.10 /usr/share/perl/5.10 /usr/local/lib/site_perl .) at lib/LDAP/Virtual.pm line 12, <DATA> line 96.
BEGIN failed--compilation aborted at lib/LDAP/Virtual.pm line 12, <DATA> line 96.
Compilation failed in require at ./bin/virtual-ldap.pl line 7, <DATA> line 96.
BEGIN failed--compilation aborted at ./bin/virtual-ldap.pl line 7, <DATA> line 96.


dpavlin@koha-upgrade:/srv/virtual-ldap$ sudo apt-get install libnet-ldap-server-perl

Zebra start

dpavlin@koha-upgrade:~$ sudo /usr/share/koha/bin/koha-zebra-ctl.sh start
Starting Zebra Server

Remove monit

dpavlin@koha-dev:~$ sudo apt-get remove monit

dpavlin@koha-dev:~$ grep koha /etc/inittab 
k1:2:respawn:/srv/virtual-ldap/safeq-ldap-koha.sh
k2:2:respawn:/srv/virtual-ldap/koha-ldap-rewrite.sh

dpavlin@koha-dev:~$ grep zebra /etc/rc.local 
/usr/share/koha/bin/koha-zebra-ctl.sh start

Zotero is a free, easy-to-use Firefox extension
to help you collect, manage, and cite your research sources. It lives right where you do
your work—in the web browser itself.

Izazov

Problem (err, izazov) je u tome da želimo imati Zotero koji se autorizira WebDAV-om koristeći račune iz Kohe. Jedna od mogućnosti je koristiti jednostavno AAIEdu LDAP server ali onda nemamo korisnike koji su samo u Kohi.

Druga ideja je bila koristiti libapache2-mod-auth-mysql za autorizaciju direktno na Koha bazu, ali nažalost izgleda da se neda konfigurirati za isti oblik md5 hash-a passworda koji koristi koha (sigh)

Ostatak uputa je strgan (i/ili star) dok ne rješim problem!

http://bugs.rot13.org/rt/Ticket/Display.html?id=397

Za korisnike Zotera

Install Zotero Firefox plugin 2.0

install

Podešavanje servera

Apache kao SSL proxy

dpavlin@koha-dev:~$ sudo a2enmod proxy_http
Considering dependency proxy for proxy_http:
Enabling module proxy.
Enabling module proxy_http.
Run '/etc/init.d/apache2 restart' to activate new configuration!

    <Proxy *>
        Order deny,allow
#       Deny from all
#       Allow from localhost
        Allow from all
    </Proxy>

    ProxyRequests       on
    ProxyPass           /zotero http://localhost:4242/zotero
    ProxyPassReverse    /zotero http://localhost:4242/zotero

Apache WebDAV

dpavlin@koha-dev:~$ sudo a2enmod dav_fs dav
Considering dependency dav for dav_fs:
Enabling module dav.
Enabling module dav_fs.
Module dav already enabled
Run '/etc/init.d/apache2 restart' to activate new configuration!
dpavlin@koha-dev:~$ sudo /etc/init.d/apache2 restart
Restarting web server: apache2 ... waiting.

Apache auth

dpavlin@koha-dev:~$ sudo apt-get install libapache2-mod-auth-mysql

dpavlin@koha-dev:~$ sudo a2enmod auth_mysql
Enabling module auth_mysql.
Run '/etc/init.d/apache2 restart' to activate new configuration!
dpavlin@koha-dev:~$ sudo /etc/init.d/apache2 restart

Directory

dpavlin@koha-dev:~$ sudo mkdir /srv/zotero

Apache vhost

dpavlin@koha-dev:~$ cat /etc/apache2/sites-available/zotero-dev.vzb.ffzg.hr 
<VirtualHost *>
        ServerName zotero-dev.vbz.ffzg.hr
        DocumentRoot /srv/zotero
        <Directory /home/srw/example.com>
                Options Indexes MultiViews
                AllowOverride None
                Order allow,deny
                allow from all
        </Directory>

                Auth_MySQL_Info localhost LOGIN PASSWORD

        <Location />

                Auth_MYSQL on

                Auth_MySQL_Password_Table borrowers
                Auth_MySQL_Username_Field userid
                Auth_MySQL_Password_Field password
                Auth_MySQL_Empty_Passwords off
                Auth_MySQL_Encryption_Types Crypt_MD5
                #PHP_MD5

                DAV On
                AuthType Basic
                AuthName "Zotero WebDAV server - use Koha login and password"
                Require valid-user

        </Location>

</VirtualHost>

dpavlin@koha-dev:/etc/apache2/sites-enabled$ sudo a2ensite zotero-dev.vzb.ffzg.hr

Test

dpavlin@koha-dev:~$ sudo apt-get install cadaver

dpavlin@koha-dev:~$ cadaver http://zotero-dev.rot13.org

Za detalje pogledajte LDAP

Virtualni LDAP omogućava Kohi da isporučuje podatke preko LDAP-a drugim sustavima, u našem slučaju, kopirkama, vidi SafeQ integration.

Drugi dio sustava je LDAP rewrite koji omogućava korištenje login@ffzg.hr bez modifikacija kohe.

upgrade

Upgrade na r61 koji ima podršku za novu koha konfiguraciju i logine bez modifikacije kohe:

# tunnel
dpavlin@llin:~$ ssh -R 8022:localhost:22 10.60.0.252

dpavlin@koha-2010-01-06:~$ cd /srv/virtual-ldap/
dpavlin@koha-2010-01-06:/srv/virtual-ldap$ svn update
A    sql
A    sql/organizationalunit.sql
A    sql/group.sql
A    sql/hreduperson.sql
U    lib/LDAP/Virtual.pm
U    lib/LDAP/Koha.pm
U    bin/ldap-rewrite.pl
Updated to revision 61.

start server process

dpavlin@koha-upgrade:~$ screen -S virtual-ldap

Pokrenuti server (inače to radi monit, ali on je deinstaliran da ne gnjavi)

dpavlin@koha-upgrade:~$ cd /srv/virtual-ldap/
dpavlin@koha-upgrade:/srv/virtual-ldap$ ./bin/virtual-ldap.pl 
LDAP server listening on port 1389

Čudan depdendency koji ne bi trebao postojati (kako radi na produkciji?)

dpavlin@koha-upgrade:/srv/virtual-ldap$ ./bin/virtual-ldap.pl 
Can't locate Net/LDAP/Server.pm in @INC (@INC contains: lib /etc/perl /usr/local/lib/perl/5.10.0 /usr/local/share/perl/5.10.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.10 /usr/share/perl/5.10 /usr/local/lib/site_perl .) at lib/LDAP/Virtual.pm line 12, <DATA> line 96.
BEGIN failed--compilation aborted at lib/LDAP/Virtual.pm line 12, <DATA> line 96.
Compilation failed in require at ./bin/virtual-ldap.pl line 7, <DATA> line 96.
BEGIN failed--compilation aborted at ./bin/virtual-ldap.pl line 7, <DATA> line 96.


dpavlin@koha-upgrade:/srv/virtual-ldap$ sudo apt-get install libnet-ldap-server-perl

MySQL baza iz komandne linije

Backup

$ mysqldump --add-drop-table --single-transaction -u _kohauser_ -p koha > 2008-11-11_koha.sql
$ mysqldump --add-drop-table -u _kohauser_ -p koha issues > 2008-11-11_koha.issues.sql

http://www.nabble.com/Backing-up-3.0-to21076508.html

Restore

$ mysql -u _kohauser_ -p koha < 2008-11-11_koha.sql
$ mysql -u _kohauser_ -p koha.issues < 2008-11-11_koha.issues.sql

Restore sa zfs

opr - zfs backup server

# Find backup snapshot to restore
dpavlin@opl:~$ ./veid2hostname.sh 
212052 koha-dev.rot13.org
212056 webpac2.rot13.org
212226 koha.ffzg.hr
dpavlin@opl:~$ sudo zfs list | grep 212226 | tail -3
opl/backup/212226@2010-01-05   662M      -  25.4G  -
opl/backup/212226@2010-01-06    28K      -  25.4G  -
opl/clone/212226-mlin         30.0M  24.5G  25.4G  /opl/clone/212226-mlin

# make clone to access files
dpavlin@opl:~$ sudo zfs clone opl/backup/212226@2010-01-06 opl/clone/koha-2010-01-06
dpavlin@opl:~$ df -h /opl/clone/koha-2010-01-06
Filesystem            Size  Used Avail Use% Mounted on
opl/clone/koha-2010-01-06
                       50G   26G   25G  51% /opl/clone/koha-2010-01-06

cpio file transfer

• mlin - hardware which provide resources
• opl - machine with backup files

root@mlin:/virtual.clone# mkdir koha-2010-01-06
root@mlin:/virtual.clone# cd koha-2010-01-06/

# start listener for cpio data transfer
root@mlin:/virtual.clone/koha-2010-01-06# nc -l -p 8888 | pv | cpio --extract --make-directories --preserve-modification-time --numeric-uid-gid --sparse

dpavlin@opl:~$ sudo bash
root@opl:~# cd /opl/clone/koha-2010-01-06
root@opl:/opl/clone/koha-2010-01-06# find . | cpio --create | pv | nc 10.60.0.93 8888

rsync file update

dpavlin@mlin:~$ sudo rsync -ravH --numeric-ids --sparse --delete --exclude 'backup*' \
  10.60.0.90:/opl/clone/koha-2010-01-06/ /virtual.clone/koha-2010-01-06/

real    24m48.767s
user    5m0.027s
sys     2m3.656s

Kopiranje postojeće virtualne mašine prije rsync-a da bi se smanjilo broj promjena koje treba prenjeti rsync-om:

dpavlin@mlin:/virtual.clone/koha.ffzg.hr$ time sudo cp -ar * ../koha-2010-01-06/

real    14m59.742s
user    0m0.932s
sys     0m38.278s

Virtualna mašina

Nakon restora sa zfs-a treba napraviti sljedeća podešavanja:

Pokrenuti screen u kojem će biti virtualna mašina

dpavlin@mlin:~$ screen -S koha-upgrade

Filesystem

lvcreate -s /dev/vg/koha -L 80G -n koha-upgrade

root@mlin:~# mount /dev/vg/koha-upgrade /virtual.clone/koha-upgrade/
root@mlin:~# df /virtual.clone/koha-upgrade/
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/mapper/vg-koha--upgrade
                      82569904  56551456  26018448  69% /virtual.clone/koha-upgrade

Start LXC

root@mlin:~# cd /srv/sysadmin-cookbook/recepies/lxc/
root@mlin:/srv/sysadmin-cookbook/recepies/lxc# ./ve2lxc.sh /virtual.clone/koha-upgrade/ 10.60.0.253 koha-upgrade

Setup inside LXC

• ugasiti monit apt-get remove monit
• provjeriti IP adrese u /etc/apache2/sites-enabled/

BTRFS

root@opl:~# zfs clone opl/backup/212226@2010-03-06 opl/clone/koha-2010-03-06

root@prod:/virtual# time rsync -rav --exclude 'backup/*' --delete 10.60.0.90::clone/koha-2010-03-06/ /virtual/koha/
receiving incremental file list
...

sent 3297036 bytes  received 4392640729 bytes  6527004.85 bytes/sec
total size is 23473104677  speedup is 5.34

real    11m13.873s
user    1m15.985s
sys     0m39.890s

root@prod:/virtual# btrfsctl -s /virtual/koha@2010-03-06 /virtual/koha
operation complete
Btrfs Btrfs v0.19

root@prod:/virtual# btrfsctl -s /virtual/koha-242 /virtual/koha
operation complete
Btrfs Btrfs v0.19

dpavlin@prod:~$ sudo bash ve2lxc.sh /virtual/koha-242 10.60.0.242 koha-242

Dokumentacija SIP2 protokola: SIP2_3M_Standard_Interchange_Protocol_2.10.pdf

Koha SIP2 server

Koha koristi SIPServer implementaciju sa https://github.com/atz/SIPServer

SIPconfig.xml

Dodati korisničke račune za svaki selfcheck jedan

<accounts>
      <login id="sc1kat"  password="**password**" delimiter="|" error-detect="enabled" institution="FFZG" />
...

I instituciju

<institutions>
    <institution id="FFZG" implementation="ILS" parms="">
          <policy checkin="true" renewal="true" checkout="true"
                  status_update="false" offline="false"
                  timeout="100"
                  retries="5" />
    </institution>

start server

run from lib directory with

perl -IC4/SIP -MILS C4/SIP/SIPServer.pm /etc/koha/SIPconfig.xml

http://bugs.koha.org/cgi-bin/bugzilla/show_bug.cgi?id=2362

Skripta za pokretanje

dpavlin@koha:/srv$ sudo ./sip2-server.sh start

syslog

SIP server zapisuje transakcije u syslog sa local6 facility:

dpavlin@koha:/var/log$ grep LOG_SIP /usr/share/koha/lib/C4/SIP/SIPServer.pm 
use constant LOG_SIP => "local6"; # Local alias for the logging facility

Da bi preusmjerili logiranje u poseban file treba dodati slijedeće u /etc/syslog.conf:

local6.*        -/var/log/sip2.log

Analiza logova

Broj različitih SIP2 poruka u našoj implementaciji

dpavlin@klin:/srv/ps-trend$ grep MSG sip.*/* | cut -d: -f6 | cut -d\' -f2 | cut -c-2 | sort | uniq -c
   6614 09
   3234 10
   7526 11
   3763 12
   4778 35
   2389 36
   4784 63
   2392 64
    828 93
    414 94
   2875 98
   5750 99

• 09 Checkin
• 10 Checkin Response

• 11 Checkout
• 12 Checkout Response

• 35 End Patron Session
• 36 End Session Response

• 63 Patron Information
• 64 Patron Information Response

• 93 Login
• 94 Login Response

• 98 ACS Status
• 99 SC Status

3M SIP emulator

3M self check emulator kako iskonfigurirati
0d 00 ne radi
0d 0A radi

Popravak za taj problem sa SIP2 server strane

Putty tunnel

Konfiguracija

C:\Program Files\3M Library Systems\3M SIP2 Development Kit\SC_Emulator

Jedina stvarno bitna promjena je:

[COM]
com_type = sockets

[TCP/IP]
ip_address = 127.0.0.1
host_name =
tcp_port = 6001

Pokretanje pod wine-om

dpavlin@klin:/virtual/win$ sudo mount kvm-winxp.img /mnt/usb/ -o loop,offset=`expr 63 \* 512`,uid=dpavlin -t ntfs
dpavlin@klin:/virtual/win$ wine /mnt/usb/Program\ Files/3M\ Library\ Systems/3M\ SIP2\ Development\ Kit/Program/SCEmul.exe

Skripta za pokretanje: SC_Emulator.sh - provjerava da li je SIP server startan i povezuje se na njega

KOHA lokalne promjene

u našem git-u

BUGS

• #250: SIP2 output encoding
• 01-PatInfo.scs
• #400: Selfcheck konfiguracija
• #408: sip2: issuingrules.finedays nedostaje

Nova implementacija

https://github.com/dpavlin/Biblio-SIP2

Primjer korištenja:

dpavlin@klin:~/klin/Net-SIP2-Simple$ ACS=10.60.0.252:6001 ./sc-emulator.pl

Integration of SafeQ and Koha

We are trying to integrate users in SafeQ and our users in Koha. Koha is library system which stores it's users into relational database. To allow SafeQ system access to users we decided to implement LDAP protocol on top of our data scheme in Koha.

This is described in little more details at: http://blog.rot13.org/2009/03/integrating_systems_using_netldapserver_and_rdbms.html

Mapping configuration

Users

Examining UMgr-LDAP.conf configuration we came up with following mapping from our RDBMS to LDAP schema: http://svn.rot13.org/index.cgi/virtual-ldap/view/sql/hreduperson.sql

we are creating objectGUID with primary key in our database and rest of the fields should be self-explanatory.

This produce following result for LDAP search query:

dpavlin@koha-dev:/srv/virtual-ldap$ ldapsearch -h 10.60.0.13 -p 2389 -b dc=ffzg,dc=hr -x 'pager=E00401001F77965C'
# extended LDIF
#
# LDAPv3
# base <dc=ffzg,dc=hr> with scope subtree
# filter: pager=E00401001F77965C
# requesting: ALL
#

# dpavlin@ffzg.hr, SURAD, ffzg.hr
dn: uid=dpavlin@ffzg.hr,ou=SURAD,dc=ffzg,dc=hr
ou: SURAD
uid: dpavlin@ffzg.hr
objectGUID: 606
cn:: RG9icmljYSBQYXZsaW51xaFpxIc=
homeDirectory: /home/606
objectClass: person
objectClass: organizationalPerson
objectClass: inetOrgPerson
objectClass: hrEduPerson
memberOf: SURAD
sn:: UGF2bGludcWhacSH
mail: dpavlin@rot13.org
pager: E00401001F77965C
givenName: Dobrica
displayName:: UGF2bGludcWhacSH

# search result
search: 2
result: 0 Success

# numResponses: 2
# numEntries: 1

This works quite well, and I can see users with their's cards in SafeQ system.

Roles

Roles are mapped into groups using following mapping: http://svn.rot13.org/index.cgi/virtual-ldap/view/sql/group.sql

Which generate LDAP groups like this:

dn:cn=SURAD,ou=SURAD,dc=ffzg,dc=hr

    members: uid=vivainfo,ou=SURAD,dc=ffzg,dc=hr
             uid=dpavlin,ou=SURAD,dc=ffzg,dc=hr
         ou: SURAD
         cn: SURAD
description: Suradnici
objectClass: group

which produce groups in Role drop down:

Some more information about defining groups in ldap can be found at: http://blog.rot13.org/2009/04/ldap_haters_guide_to_groups.html

Const centre

Groups which we have defined in Koha are really only useful for reporting, so it seems that cost centres in SafeQ are the right place to import our groups.

We are trying to use following mapping: http://svn.rot13.org/index.cgi/virtual-ldap/view/sql/organizationalunit.sql

Idea is to expose same group data as organizationalUnits in SafeQ so we can get accounting by those groups. We would also like to have different prices for each group of users and ability to report using groups from Koha.

Changing configration to:

# Mapping of LDAP containers to SafeQ cost centres (departments)
# If enabled, all organisational units containers will be displayed in SafeQ as cost centres
# If disabled (no, false), attribute mapping is used - see ldap_ou
ldap_map_ou = yes

We get const centers mapped from our organizational units:

but all const centres have same number (0)

How can we supply SafeQ with correct cost center number so users can end up in correct one?

Possible bugs in SafeQ

LDAP search

I also found out something which seems like a bug in the way SafeQ search LDAP server: when you search for 'dpavlin' as login/alias I get following queries:

## filter and [

 { equalityMatch => { assertionValue => "HrEduPerson", attributeDesc => "objectclass" }, },
 { equalityMatch => { assertionValue => "dpavlin%", attributeDesc => "uid" }, },
]

objectclass is o.k., but uid looks like uid=dpavlin% which I think it should be uid=dpavlin* to be correct LDAP syntax.

This query doesn't return anything, but next one is o.k.:

## filter and [

 { equalityMatch => { assertionValue => "HrEduPerson", attributeDesc => "objectclass" }, },
 { substrings => { substrings => [{ any => "dpavlin" }], type => "uid" }, },
]

which is uid=*dpavlin* and it finds user.

Role/Cost Centere drop-down

Selecting role of const center doesn't change filtered output of users. I don't see any difference in LDAP search query when changing selected role and/or cost centar. Is that normal?

Ova stranica dokumentira naša podešavanja (i pokušaje) za što bržom Koha instalacijom.

Apache deflate kompresija

Smanjuje veličinu stranice koja se isporučije browersu.

Session

dpavlin@koha:~$ sudo ./mk-query-digest /var/log/mysql/mysql-slow.log

# Profile
# Rank Query ID           Response time    Calls R/Call   Item
# ==== ================== ================ ===== ======== ================
#    1 0xC7A803CDD4FE9A36 30517.0000 45.5%   349  87.4413 INSERT UPDATE sessions
#    2 0xB4F2B316DFE865C8  8027.0000 12.0%   119  67.4538 SELECT sessions
#    3 0x6019E0D94A244FF5  3952.0000  5.9%   275  14.3709 SELECT opac_news
#    4 0x1F809CA9753CDEE7  2753.0000  4.1%    23 119.6957 SELECT biblio
#    5 0x27CE7D5D2BC5F598  2305.0000  3.4%   206  11.1893 SELECT fieldmapping
#    6 0xB0F504DD073A49CB  2192.0000  3.3%    30  73.0667 SELECT issues items biblio biblioitems
#    7 0x8ED635CB153D27A5  2146.0000  3.2% 19313   0.1111 SELECT reserves reserveconstraints
#    8 0xDB6DC1962741AB10  1978.0000  3.0%     7 282.5714 SELECT biblio biblioitems itemtypes
#    9 0x32783383AEA5AD49  1642.0000  2.4%    10 164.2000 SELECT items
#   10 0x6DD9F09DA2455228  1361.0000  2.0%     8 170.1250 DELETE sessions

Promjeniti SessionStorage u "as temporary files" i opcionalno pomaknuti ih u /dev/shm umjesti o u /tmp/:

dpavlin@koha:~$ diff -urw /srv/koha/C4/Auth.pm /usr/share/koha/lib/C4/Auth.pm
--- /srv/koha/C4/Auth.pm        2010-02-20 21:41:34.000000000 +0100
+++ /usr/share/koha/lib/C4/Auth.pm      2010-04-26 16:03:17.671211497 +0200
@@ -1341,7 +1341,7 @@
     }
     else {
         # catch all defaults to tmp should work on all systems
-        $session = new CGI::Session("driver:File;serializer:yaml;id:md5", $sessionID, {Directory=>'/tmp'});
+        $session = new CGI::Session("driver:File;serializer:yaml;id:md5", $sessionID, {Directory=>

Profile

Devel::NYTProf

instalacija:

root@koha-dev-git-reorg:~# cpan Devel::NYTProf

profile search query:

root@koha-dev-git-reorg:/usr/share/koha/opac/cgi-bin/opac# time perl -d:NYTProf -I/usr/share/koha/lib/ opac-search.pl q=human | wc
   1553    3259   58648

real    0m4.001s
user    0m3.152s
sys     0m0.560s

generate html report:

root@koha-dev-git-reorg:/usr/share/koha/opac/cgi-bin/opac# nytprofhtml 
Generating report...
Reading nytprof.out
Writing report to nytprof directory

koha-240

First run

dpavlin@koha-240:/tmp$ time perl -d:NYTProf -I/usr/share/koha/lib/ /usr/share/koha/opac/cgi-bin/opac/opac-search.pl q=human | wc
Use of uninitialized value $borrowernumber in string eq at /usr/share/koha/opac/cgi-bin/opac/opac-search.pl line 483.
Use of uninitialized value in string eq at /usr/share/koha/opac/cgi-bin/opac/opac-search.pl line 486.
   1962    3177   64512

real    0m8.561s
user    0m5.708s
sys     0m0.724s

Second run

dpavlin@koha-240:/tmp$ time perl -d:NYTProf -I/usr/share/koha/lib/ /usr/share/koha/opac/cgi-bin/opac/opac-search.pl q=human | wc
Use of uninitialized value $borrowernumber in string eq at /usr/share/koha/opac/cgi-bin/opac/opac-search.pl line 483.
Use of uninitialized value in string eq at /usr/share/koha/opac/cgi-bin/opac/opac-search.pl line 486.
   1962    3177   64512

real    0m6.664s
user    0m5.636s
sys     0m0.816s

Drop caches and run profile:

dpavlin@koha-240:/tmp$ sudo sh -c 'echo 3 > /proc/sys/vm/drop_caches'

Zebra reindex

dpavlin@koha-240:/srv/koha$ sudo -u koha ./misc/migration_tools/rebuild_zebra.pl -b -v -r -d /tmp/indexing -k -x -nosanitize

Dio Koha virtual ldap repozitorja:

http://svn.rot13.org/index.cgi/virtual-ldap/log/bin/ldap-rewrite.pl

features

• rewrite LDAP bind request cn: username@domain.com -> uid=username,dc=domain,dc=com
• rewrite search responses:
• expand key:value pairs from hrEduPersonUniqueNumber into hrEduPersonUniqueNumber_key
• augment response with yaml/dn.yaml data (for external data import)

start

dpavlin@koha-upgrade:/srv/virtual-ldap$ ./bin/ldap-rewrite.pl 
# config = {
  "listen"       => "localhost:1389",
  log_file       => "log",
  overlay_prefix => "ffzg-",
  upstream_ldap  => "ldap.ffzg.hr",
  upstream_ssl   => 1,
  yaml_dir       => "./yaml/",
} at ./bin/ldap-rewrite.pl line 59.

changes

Koristi Webconverger distribuciju za kreiranje web kioska

Dodatno instalirani paketi

• dropbear
• http://webconverger.com/xpis/webcnoaddressbar.xpi - skrivanje address bar-a

Lokalne Webconverger modifikacije

instalacija

root@opr:/srv/pxelator# apt-get install squashfs-tools aufs-tools aufs-modules-`uname -r`

promjene

dpavlin@opr:/srv/pxelator$ ./bin/webc-overlay.sh 
+ mount+ egrep /tmp/(base|export|changes)

+ sudo mount /srv/pxelator/tftp/webconverger/iso/live/filesystem.squashfs /tmp/base/ -o loop
+ mkdir /tmp/changes /tmp/base /tmp/export
mkdir: cannot create directory `/tmp/changes': File exists
mkdir: cannot create directory `/tmp/base': File exists
mkdir: cannot create directory `/tmp/export': File exists
+ sudo mount -t aufs -o br:/tmp/changes/:/tmp/base/ none /tmp/export/
+ sudo chroot /tmp/export
root@opr:/# 

Nakon Ctrl+D rebuildati će se /srv/pxelator/tftp/webconverger/custom.squashfs koji koriste katalozi za boot.

Instalacija zpl printera na Windowse

Nova verzija printanja koristi Koha Spine Label printanje i zahtjeva instalaciju Zebra printera na Windowsima prema
uputama na https://github.com/dpavlin/Printer-Zebra/blob/master/README

Video instalacije

Upute za instalaciju Zebra printera / Vivainfo

Pritanje signatura zahtjeva ODBC driver za MySQL i korisnika na bazi sa kojim će se spajati program.

Nazivi korisnika:

• printer_zs - Zatvoreno spremište
• printer - svi ostali printeri, migrirati na nazive

Dodavanje korisnika u MySQL:

dpavlin@koha:~$ mysql -u root mysql

mysql> create user printer_zs identified by 'password_za_ovaj_account' ;
Query OK, 0 rows affected (0.01 sec)

mysql> grant select,insert on koha.items_print_log to 'printer_zs' ;
Query OK, 0 rows affected (0.15 sec)

mysql> grant select on koha.items to 'printer_zs' ;
Query OK, 0 rows affected (0.00 sec)

mysql> grant select on koha.biblio to 'printer_zs' ;
Query OK, 0 rows affected (0.00 sec)

Passwordi za printere nalaze se na zaštićenom wiki-ju: Zebra printer

Provjera:

mysql> select * from tables_priv ;
+------+------+------------+-----------------+----------------+---------------------+---------------+-------------+
| Host | Db   | User       | Table_name      | Grantor        | Timestamp           | Table_priv    | Column_priv |
+------+------+------------+-----------------+----------------+---------------------+---------------+-------------+
| %    | koha | printer    | items_print_log | root@localhost | 2009-03-27 12:12:17 | Select,Insert |             | 
| %    | koha | printer    | items           | root@localhost | 2009-03-27 12:14:38 | Select        |             | 
| %    | koha | printer    | biblio          | root@localhost | 2009-03-27 12:15:03 | Select        |             | 
| %    | koha | printer_zs | biblio          | root@localhost | 2010-03-09 14:26:30 | Select        |             | 
| %    | koha | printer_zs | items           | root@localhost | 2010-03-09 14:26:24 | Select        |             | 
| %    | koha | printer_zs | items_print_log | root@localhost | 2010-03-09 14:26:19 | Select,Insert |             | 
+------+------+------------+-----------------+----------------+---------------------+---------------+-------------+
6 rows in set (0.00 sec)

Stare bilješke:

Iz tablice items_print_log obnoviti podatak items.datelastseen.

Provjeriti verziju

dpavlin@koha-dev:/srv/koha$ grep VERSION /srv/koha/C4/Auth_with_ldap.pm 
use vars qw($VERSION @ISA @EXPORT @EXPORT_OK %EXPORT_TAGS $debug);
        $VERSION = 3.10;        # set the version for version checking

/etc/koha/koha-conf.xml

<ldapserver id="ldapserver" listenref="ldapserver">
<!--
 <hostname>ldaps://ldap.ffzg.hr</hostname>
-->
 <hostname>ldap://localhost:1389</hostname>
 <base>dc=ffzg,dc=hr</base>

 <replicate>1</replicate>  <!-- add new users from LDAP to Koha database -->
 <update>0</update>        <!-- update existing users in Koha database -->

 <auth_by_bind>1</auth_by_bind>
 <principal_name>%s</principal_name> <!-- optional, for auth_by_bind: a printf format to make userPrincipalName from koha userid -->

 <mapping>            <!-- match koha SQL field names to your LDAP record field names -->
    <firstname   is="givenname"     ></firstname>
    <surname     is="sn"            ></surname>
    <address     is="ffzg-ml_postanska_adresa_0" ></address>
<!--
    <city        is="ffzg-prebivaliste_mjesto" ></city>
-->
    <city        is="ffzg-ml_postanska_adresa_1" ></city>
    <zipcode     is="ffzg-prebivaliste_postanski_broj"></zipcode>

    <branchcode  is="local-branch"        >FFZG</branchcode>
    <userid      is="hredupersonuniqueid"  ></userid>
    <password    is="userpassword"  ></password>
    <email       is="mail"          ></email>
    <categorycode is="local-categorycode"  >IMP</categorycode>

    <dateofbirth is="ffzg-datum_rodjenja" ></dateofbirth>
    <sex is="ffzg-spol" ></sex>
    <phone is="ffzg-ml_telefoni_fixed"></phone>
    <mobile is="ffzg-ml_telefoni_mobile"></mobile>

 </mapping>
</ldapserver>

Koristi LDAP rewrite

Da bi sve radilo potrebno je ugasiti ExtendedPatronAttributes na https://10.60.0.252:8443/cgi-bin/koha/admin/preferences.pl?tab=patrons