Create SD Image Version 0.7.4

From HiveTool
Revision as of 03:49, 1 January 2017 by Paul (talk | contribs)
Jump to: navigation, search

This page describes how the bootable Raspian-HiveTool image was created. This is for information only. The easiest and best way to install Hivetool is to download the latest image.

Release Candidate 1 of this 0.7.4 image is available: https://drive.google.com/open?id=0B_3xqxGS2psWQmJvLUt3c0p6RzQ It does not have HiveControl installed yet.

hivetool074rc1a.img.zip is 3170992305 bytes
hivetool074rc1a.img is 6706946560 bytes

md5sum hivetool074rc1a.img.zip   e0c8d803211e7a1191f942093a719c82
sha1sum hivetool074rc1a.img.zip  0a513fdf37dcd4d29d0b71ef93b076bd9f8ee4b1 


md5sum hivetool074rc1a.img   a468fdf9a12f6e86c4b1523a07ae327d
sha1sum hivetool074rc1a.img  533b489e1381d94aeca748485df1c51ce94d5555 

Release Candidate 2 of this 0.7.4 image is available: It does not have HiveControl installed yet.

hivetool074rc2.img is 5277458944  bytes
hivetool074rc2.img.zip is 2211836239 bytes

md5sum hivetool074rc2.img e38424d044cf2caeb8e4e2f4e384ce99
sha1sum hivetool074rc2.img 202c17f7c59836058fcc84af766af2809193a5db

md5sum hivetool074rc2.img.zip 380158822814b97a6f64d2718541905c
sha1sum hivetool074rc2.img.zip 965ea4e00184f16062fb22d586c9118695a7e53b

0.7.4

Bug Fixes

1. Set GPU_MEM, GPU_MEM_256, GPU_MEM_512, and GPU_MEM_1024 for different Pi models in config.txt. Maybe:

GPU_MEM=64
GPU_MEM_256=64
GPU_MEM_512=128
GPU_MEM_1024=256

2. Put sanity checks, retrying, and error logging in dht22.sh to prevent bad readings from DHT22. See http://hivetool.org/d/comment/151#comment-151 for details.

3, Update the SQL database creation scripts to reflect the new schema with battery voltage.

4. Use hive_stats3wDownload.pl and NOT hive_stats4wDownload.

5. Fix hive config.pl so it will insert a NULL instead on nothing in the hive_parameters table if hive elevation is left blank.

6. Change DHT22 code to Adafruit

7. Fix error at end of hivetool.log if hive_command.pl is not executable.

Feature Request

  1. add latest Hive Control software
  2. implement battery voltage monitoring using channel B of HX711, send it to hivetool.net and display it.
  3. add way to upgrade to new images (add database conversion script if necessary).
  4. send host IP (lan) to hivetool.net

0.7.3

Bug Fixes

  1. Done replace hx711 and dth22 code with fixed versions.
  2. Done add export LC_NUMERIC="en_US.UTF-8" to hive.sh
  3. Done don't remove python tools when removing bloatware. Keep: wolfram-engine - a scientific platform, Idle and Idle3 - python language editors


Feature Request

  1. Done add Ryans Hive Controller code
  2. Done add xrdp, open62541 packages
  3. Done add Data Acquisition Daemon (DAD) code

Dad supports battery voltage monitoring and the rain gauge.


0.7.2

  1. Done Test most recent raspbian distro Jessie (4.1 Kernel)
  2. Done Removal of bloatware from Raspbian (games, educational, etc.)
  3. Done Hivetool Support Pi & Pi2 (auto detect preferred)
  4. Automatic removal of erroneous data from sensors
  5. Done Basic navigation from webserver index.html, especially config.pl and Hivestats with download.
  6. Menu driven selection & configuration of sensors (gpio 2,3 for DHT22s preassigned by menu default)
  7. Menu driven setup of essential parameters with choices that don't crash app when saving, grey out unused.
  8. Done Sensor calibration provisions (gain, offset)
  9. Display instantaneous sensor readings from config screen with read button
  10. Preload & configure Apache Webserver and database, Hivetool, sensor drivers for proven sensors.
  11. Update local & online hivestats graphs to display lux trend pen, (use latest hivestats with enhanced autoscaling for local)
  12. Network / wifi support out of the box seems to work well now, handle configuration on router side with DHCP reservation as may be needed.
  13. Add configuration menu item for naming pi, same as hivestats name?
  14. Minimize need to enter Raspiconfig, can timezone and time all be handled in hivetool config?
  15. Done Enable i2c & serial.


How the image was created

Get latest Jessie image

Download, verify the SHA-1 checksum, unzip, burn image.

Verify the checksum:

sha1sum 2016-05-10-raspbian-jessie.zip
66a50545358e80229d77ebba89ab01f1c0fb4a02

Unzip the image and copy it to the SD card

unzip 2016-05-10-raspbian-jessie.zip
dd bs=4M if=2016-05-10-raspbian-jessie.img of=/dev/sdb

Boot

Jessie boots directly into the window system. Menu -> Preferences->Raspberry Pi Configuration

Set up Wi-Fi

1. Add your network information to /etc/wpa_supplicant/wpa_supplicant.conf. For an unencrypted open network with an ESSID of dlink:

vi /etc/wpa_supplicant/wpa_supplicant.conf
network={
ssid="dlink"
key_mgmt=NONE

auth_alg=OPEN }

2. Wi-Fi auto reconnect to AP

Go to /etc/ifplugd/action.d/ and copy the ifupdown file to ifupdown.org

cp /etc/ifplugd/action.d/ifupdown /etc/ifplugd/action.d/ifupdown.org

Then copy the ifupdown.sh script provided with wpa supplicant to /etc/ifplugd/action.d/

cp /etc/wpa_supplicant/ifupdown.sh  /etc/ifplugd/action.d/ifupdown

http://raspberrypi.stackexchange.com/questions/4120/how-to-automatically-reconnect-wifi

Update, upgrade

update your system's package list and then upgrade all your installed packages to their latest versions:

sudo apt-get update
sudo apt-get dist-upgrade

Update the GPU firmware

sudo apt-get install rpi-update
sudo rpi-update


Remove packages we don't need

sudo apt-get remove --purge penguinspuzzle scratch dillo squeak-vm squeak-plugins-scratch sonic-pi netsurf-gtk netsurf-common
sudo apt-get autoremove
sudo apt-get clean
rm -rf /home/pi/python_games
sudo rm -rf /opt/minecraft-pi

https://project.altservice.com/issues/418 NO! Don't do this if you want to use the video camera: sudo rm -rf /opt/vc



Install packages we need

sudo apt-get -y install gawk bc apache2 libusb-dev libgd-graph-perl libexpat1-dev sqlite3
sudo apt-get install dh-autoreconf libudev-dev libusb-1
pi@raspberrypi:~ $  sudo apt-get install dh-autoreconf libudev-dev libusb-1
Reading package lists... Done
Building dependency tree       
Reading state information... Done
E: Unable to locate package libusb-1

Oops. What happened to libusb-1? Hope it is not needed ... OK, We'll go on without it ...

sudo apt-get install dh-autoreconf libudev-dev 

Install perl modules

sudo cpan GD::Text GD::Graph Date::Format XML::Simple DBI DBD::SQLite

Install HiveTool software

Create symbolic links to the hivetool log files:

sudo ln -s /home/hivetool/hivetool_raw.db /var/www/html
sudo ln -s /home/hivetool/hive.conf /var/www/html
sudo ln -s /home/hivetool/hivetool.log /var/www/html

Patch perl module GD::Graph

The Perl Module, GD::Graph needs a patch to correctly draw a graph with two y axes. Note that the target directory changes with each new perl version. This time it is 5.20.2. Copy the patched file to it's proper location:

sudo cp /home/downloads/axestype.pm /usr/local/share/perl/5.20.2/GD/Graph/

Web Server

Configure apache

  1. Link the cgi.load and include.load module to mods-enabled
    ln -s /etc/apache2/mods-available/cgi.load /etc/apache2/mods-enabled
    ln -s /etc/apache2/mods-available/include.load /etc/apache2/mods-enabled
  2. Add .pl to AddHandler cgi-script
    sudo vi /etc/apache2/mods-enabled/mime.conf
    uncomment #AddHandler cgi-script .cgi (around line 219) and add .pl so it looks like:
    AddHandler cgi-script .cgi .pl
  3. add Includes and +ExecCGI to Options:
    sudo vi /etc/apache2/apache2.conf
    In stanza <Directory /var/www/>
    change
    Options Indexes FollowSymLinks
    to
    Options Indexes FollowSymLinks Includes ExecCGI
  4. Add index.shtml to DirectoryIndex:
    sudo vi /etc/apache2/mods-enabled/dir.conf
    Change
    DirectoryIndex index.html index.cgi index.pl index.php index.xhtml index.htm
    to
    DirectoryIndex index.html index.cgi index.pl index.php index.xhtml index.htm index.shtml
  5. Set up apache to listen on port 8080 if using port forwarding:
    sudo vi /etc/apache2/ports.conf
    add Listen 8080
  6. Restart Apache
sudo apachectl restart   or      sudo/etc/rc4.d/S02apache2 restart

Set sudo user privileges for Apache

This is necessary to allow config.pl to read the sensors. Run visudo to edit the sudo config file:

sudo visudo

and insert this line in the "User privilege specification" section:

www-data ALL=NOPASSWD: /usr/local/bin/2591, /usr/bin/nice, /home/hivetool/temperhum.sh, /usr/local/bin/hx711, /usr/local/bin/Seeed_DHT22

Create SQLite database

cd /home/hivetool
sqlite3 hivetool_raw.db
sqlite> .read create_hivetool_sqlite.sql
sqlite> .quit

Make it writable or config.pl will fail to save to the database.

sudo chmod a+w /home/hivetool/hivetool_raw.db
sudo chmod a+w /home/hivetool

Create a symbolic link to /home/hivetool/hivetool_raw.db from /var/www/html so hive_stats.pl and hive_graphX.pl can access the database:

sudo ln -s /home/hivetool/hivetool_raw.db /var/www/html/

phpLiteAdmin ver 1.9.6

Install SQLite database administration tools. https://www.phpliteadmin.org/download/

sudo apt-get install php5 php5-sqlite
cd /var/www/html
sudo mkdir admin
cd admin
sudo cp /home/downloads/phpLiteAdmin_v1-9-6.zip .
sudo unzip phpLiteAdmin_v1-9-6.zip

http://www.raspitux.de/en/using-phpliteadmin-with-raspberry-pi/#respond

sudo cp phpliteadmin.config.sample.php phpliteadmin.config.php
vi phpliteadmin.config.php

change

$directory = '.';  

to

$directory = '..';

Install TEMPerHUM software

sudo apt-get update
sudo apt-get install dh-autoreconf libudev-dev libusb-1.0-0-dev cmake-curses-gui
cd /home/downloads
sudo git clone git://github.com/signal11/hidapi
cd hidapi
sudo ./bootstrap
sudo ./configure
sudo make
sudo make install
cd ..
#sudo git clone git://github.com/edorfaus/TEMPered
#cd TEMPered
#sudo git clone https://github.com/rcrum003/TEMPered-v6-2015
#cd TEMPered-v6-2015
git clone git://github.com/mushisushi/TEMPered/
sudo ccmake .

Then the sub commands: "c" to configure then "g" to save and go

sudo make
sudo make install

Add /usr/local/lib/arm-linux-gnueabihf/ to /etc/ld.so.conf

sudo vi /etc/ld.so.conf

So it looks like this:

include /etc/ld.so.conf.d/*.conf
/usr/local/lib/arm-linux-gnueabihf/


Run ldconfig to pick up the new libraries

sudo ldconfig

Install Broadcom 2835 Library ver 1.5

Download and install the bcm2835 library: https://gist.github.com/annem/3183536

cd /home/downloads
wget http://67.192.60.197/mikem/bcm2835/bcm2835-1.5.tar.gz
tar xvfz bcm2835-1.5.tar.gz
cd bcm2835-1.5
./configure
make
sudo make check
sudo make install

Install i2c support

  1. Install i2c tools
    apt-get install i2c-tools
  2. run raspi-config and turn on i2c

Install wiringPi library ver 2.32

  1. get wiringPi code from github and compile it
    cd /home/downloads
    git clone git://git.drogon.net/wiringPi
    cd wiringPi
    ./build
  2. Test
    gpio -v
    gpio readall
gpio -v
gpio version: 2.32
Copyright (c) 2012-2015 Gordon Henderson

http://wiringpi.com/download-and-install/

DHT22 Temperature/Humidity Sensor

Groove Seeed - DHT22 with modified code. Note that the code has been modified to return the temperature and humidity in floating point instead of having to divide it by 10, and a few other "improvements".

  1. Install wiringPi libraries
  2. Get the DHT22 software
    cd /home/downloads
    sudo git clone https://github.com/Seeed-Studio/Grove-RaspberryPi.git
    cd Grove-RaspberryPi/Grove\ -\ Temperature\ and\ Humidity\ Sensor\ Pro
    make
    sudo cp Seeed_DHT22 /usr/local/bin

Python DHT22 code from Adafruit

sudo apt-get install python-dev
cd /home/downloads
git clone https://github.com/adafruit/Adafruit_Python_DHT.git
cd Adafruit_Python_DHT
sudo python setup.py install
cd examples
python AdafruitDHT.py


DHTxx Temperature/Humidity Sensor

This code uses the PiGPIO libraries (pigpiod).

  1. Download the DHT11/21/22/33/44 Sensor code from http://abyz.co.uk/rpi/pigpio/code/DHTXXD.zip
  2. Unzip
  3. compile

Note that this code uses the Broadcom GPIO numbering so Ras Pi GPIO 2 <=> Broadcom GPIO 27 Ras Pi GPIO 3 <=> Broadcom GPIO 22


HX711 weight ADC

hx711wp

Note: The original hx711 code has been modified to use the wiringPi library and a bug fixed.

  1. Download the software from gitHub
    cd /home/downloads
    sudo git clone https://github.com/ggurov/hx711
  2. replace hx711.c with hx711wp.c and add locking.h
  3. compile
    gcc -o hx711wp hx711wp.c -lwiringPi
  4. Copy hx711 command to /usr/local/bin:
    sudo cp hx711wp /usr/local/bin/hx711
  5. To read the battery voltage, copy hx711wp_chanB command to /usr/local/bin:
    sudo cp hx711wp_chanB /usr/local/bin/hx711wp_chanB


TLS2591 Lux Sensor

2591 Adafruit with modified code.

-rw-r--r-- 1 root root 10439 Aug  3 01:36 2591a.cpp
-rw-r--r-- 1 root root  3303 Aug  3 01:36 2591a.h
-rw-r--r-- 1 root root  1509 Aug  3 01:36 2591_pi_2.cpp
gcc 2591_pi_2.cpp 2591a.cpp -lwiringPi -o 2591 
cp 2591 /usr/local/bin

Add crontab entries

Edit crontab:

sudo crontab -e

Add to crontab:

# Check hive instruments every 5 minutes. Kill process after 3 1/2 minutes.
0,5,10,15,20,25,30,35,40,45,50,55 * * * * timeout -s KILL 3.5m /home/hivetool/hive.sh
#
# Check the server status. Kill process after 1 minute.
4,9,14,19,24,29,34,39,44,49,54,59 * * * * timeout -s KILL 1m /home/hivetool/server_status.sh > /var/www/server_status.txt

Video

Install VLC media software. Note that for the camera to work, it must be enabled by running raspi-config.

sudo apt-get install vlc

To automatically start the video streaming using Real Time Streaming Protocol to port 8554, add to /etc/rc.local

# start video stream
su pi /home/hivetool/stream_video.sh

/home/hivetool/stream_video.sh should be:

raspivid -n -o - -t 0 -w 800 -h 400 -fps 24 |cvlc -vvv stream:///dev/stdin --sout '#rtp{sdp=rtsp://:8554}' :demux=h264

This method uses raspivid to streams video from the PiCam to vlc where is can be accessed with videoLAN, a free and open souce media player for Apple, Linux, Microsoft platforms at port 8554 using RTSP://hive.ip:8554

Access Point

sudo apt-get install hostapd isc-dhcp-server

https://learn.adafruit.com/setting-up-a-raspberry-pi-as-a-wifi-access-point/install-software

gEDA Schematic/PCB layout software

sudo apt-get update
sudo apt-get install geda
sudo apt-get install pcb
sudo apt-get install gerbv
sudo apt-get install zip

xrdp

sudo apt-get install xrdp

open62541

sudo git clone git://github.com/open62541/open62541
# ### sudo apt-get install git build-essential gcc pkg-config cmake python python-lxml
sudo apt-get install cmake cmake-data python-lxml
# enable additional features
sudo apt-get install libexpat1-dev # for XML-encodingi  ### already done
sudo apt-get install liburcu-dev # for multithreading
sudo apt-get install check # for unit tests
sudo apt-get install graphviz doxygen # for documentation generation 

sudo cd open62541
sudo mkdir build
sudo cd build
sudo cmake ..
sudo make

# select additional features
sudo ccmake .. # enter g to build and exit
sudo make

Install touchscreen pop up keyboard support

sudo apt-get install matchbox

Install I2S support

sudo apt-get install raspberrypi-kernel-header
cd /home/downloads
git clone https://github.com/skakri/asoc-i2s-loader
cd asoc-i2s-loade
make
... to be continued ...

in /boot/config.txt

# Uncomment to enable I2S MEMs microphone 6-9-16 AO
dtparam=i2s=on

in /sys/kernel/debug/asoc/platforms get the platform and device name. Change in the asoc-i2s-loader.c

3f203000.i2s
snd-soc-dummy

in /etc/modprobe.d/raspi-blacklist.conf

blacklist snd_soc_wm8804
blacklist snd_soc_pcm512x
blacklist snd_soc_tas5713


To record:

arecord -D hw:0 -c2 -r 48000 -f S32_LE -t wav -v file.wav

Install Hivecontrol

  1. Download
  2. Unzip in /home/hivetool2.
  3. Copy /home/hivetool2/www/public_html/ files to /var/www/html/hivecontrol
  4. Set up virtual host on port 81
  5. Add path to phpSQLiteadmin to database file.
hive-data.db -> /home/HiveControl-master/data/hive-data.db

This may not be right, should link to /home/hivetool2?

Install Desktop Background and Icons

Write Image

Copy the image to another computer:

1. Remove the SD card from the Pi and on another computer, copy the image to a file:

dd bs=4M if=/dev/sdb of=/home/downloads/hivetool073.img

2. Shrink the image:

http://sirlagz.net/2013/03/10/script-automatic-rpi-image-downsizer/

3. Compress the image using zip:

zip 2016-02-09-raspbian-hivetool.zip hivetool073.img