Tag Archives: bash

Bash script to backup my configs (dotfiles)

Posted by cviorel on June 17, 2011 1 comment | This post has 1,008 views.

I needed some script to take care of my config files and put them in a single directory. So here it is.

#!/bin/bash

# Display All Hidden Dot Files In a Directory
# ls -a | egrep "^\." > backup_dotfiles.sh

DESTINATION="/storage/dotfiles"  # do not use a trailing slash (/)

# Colors
blue="\e[0;34m"
green="\e[1;32m"
red="\e[0;31m"
bold="\e[1;30m"
reset="\e[0m"

# file list (use trailing slash for directories)
FILES="
.bash_aliases
.bash_logout
.bash_profile
.bashrc
.colours/
.config/openbox/
.config/terminator/
.config/tint2/
.config/zathura/
.devilspie/
.fehbg
.fonts.conf
.gtk-bookmarks
.gtkrc-2.0
.gtkrc-2.0.mine
.inputrc
.mplayer/
.nanorc
.rtorrent.rc
.screenrc
.synergy.conf
.vim/colors/
.vimrc
.xbindkeysrc
.Xdefaults
.xinitrc
.xmod
.Xmodmap
.xsession
.xxkb/
.xxkbrc
"
for file in $FILES
do
   if [ -d $file ]; then
      mkdir -p $DESTINATION/$file
      cp -f $HOME/$file* $DESTINATION/$file
   elif [ -f $file ]; then
      cp -f $HOME/$file $DESTINATION
   else
      echo -e "$red:: $file is not a file/directory! $reset"
   fi     
done

echo -e "$green:: Done! $reset"
exit 0

#!/bin/bash

# Display All Hidden Dot Files In a Directory

# ls -a | egrep "^\." > backup_dotfiles.sh

DESTINATION="/storage/dotfiles" # do not use a trailing slash (/)

# Colors

blue="\e[0;34m"

green="\e[1;32m"

red="\e[0;31m"

bold="\e[1;30m"

reset="\e[0m"

# file list (use trailing slash for directories)

FILES="

.bash_aliases

.bash_logout

.bash_profile

.bashrc

.colours/

.config/openbox/

.config/terminator/

.config/tint2/

.config/zathura/

.devilspie/

.fehbg

.fonts.conf

.gtk-bookmarks

.gtkrc-2.0

.gtkrc-2.0.mine

.inputrc

.mplayer/

.nanorc

.rtorrent.rc

.screenrc

.synergy.conf

.vim/colors/

.vimrc

.xbindkeysrc

.Xdefaults

.xinitrc

.xmod

.Xmodmap

.xsession

.xxkb/

.xxkbrc

for file in $FILES

if [ -d $file ]; then

mkdir -p $DESTINATION/$file

cp -f $HOME/$file* $DESTINATION/$file

elif [ -f $file ]; then

cp -f $HOME/$file $DESTINATION

else

echo -e "$red:: $file is not a file/directory! $reset"

done

echo -e "$green:: Done! $reset"

exit 0

Search and remove duplicate files

Posted by cviorel on October 14, 2009 No comments | This post has 612 views.

Here a small piece of code which will search for the duplicates in the path you supply. It will generate a new file which contains the commands for deleting those duplicates.
Make sure you double check the resulting file!
The script requires that you have fdupes installed.
Install it in Ubuntu/Debian by running the following command in your terminal:

sudo aptitude install fdupes

1	sudo aptitude install fdupes

#!/bin/bash

OUTF='rm-dups.sh'
echo "#!/bin/bash" > $OUTF
fdupes -r -f $1 | sed -r 's#(.+)#rm '\"'\1'\"'#' >> $OUTF
chmod +x $OUTF

#!/bin/bash

OUTF='rm-dups.sh'

echo "#!/bin/bash" > $OUTF

fdupes -r -f $1 | sed -r 's#(.+)#rm '\"'\1'\"'#' >> $OUTF

chmod +x $OUTF

Fix Google Earth 5.0 user interface font on Linux

Posted by cviorel on September 2, 2009 3 comments | This post has 873 views.

I installed Google Earth 5.0 and the ugly UI font from the beta is still here.
Based on the comments from Google Earth Help page from here I’ve created the following script wich will fix the user interface font issue.

#!/bin/bash

sudo aptitude -y install libqt4-webkit
ge=`which googleearth`

if [ -n "$ge" ]; then
    ## get the path and check if it is a symlink
    if [ -h "$ge" ]; then
        real_path=`readlink -e $ge`
        dir_path=`dirname $real_path`
    else
        real_path=`dirname $ge`
    fi

    ## backup original Qt4 libraries
    for i in `ls $dir_path | grep libQt`; do
		sudo mv -v $dir_path/$i $dir_path/$i"_backup"
    done

	## backup original Qt4 plugins
    for j in `ls $dir_path/plugins/imageformats | grep libq`; do
		sudo mv -v $dir_path/plugins/imageformats/$j $dir_path/plugins/imageformats/$j"_backup"
    done

	## create a new qt.conf file
cat > $HOME/qt.conf << "EOF"
[Paths]
Documentation=/usr/share/doc
Libraries=/usr/lib
Plugins=/usr/lib/qt4/plugins
Translations=/usr/lib/qt4/translations
EOF

	sudo mv -v $dir_path/qt.conf $dir_path/qt.conf_backup
	sudo mv -v $HOME/qt.conf $dir_path
	
elif [ -z "$ge" ]; then
		echo -e "You don't have Google Earth installed!\n"
		exit
fi

exit 0

#!/bin/bash

sudo aptitude -y install libqt4-webkit

ge=`which googleearth`

if [ -n "$ge" ]; then

## get the path and check if it is a symlink

if [ -h "$ge" ]; then

real_path=`readlink -e $ge`

dir_path=`dirname $real_path`

else

real_path=`dirname $ge`

## backup original Qt4 libraries

for i in `ls $dir_path | grep libQt`; do

sudo mv -v $dir_path/$i $dir_path/$i"_backup"

done

## backup original Qt4 plugins

for j in `ls $dir_path/plugins/imageformats | grep libq`; do

sudo mv -v $dir_path/plugins/imageformats/$j $dir_path/plugins/imageformats/$j"_backup"

done

## create a new qt.conf file

cat > $HOME/qt.conf << "EOF"

[Paths]

Documentation=/usr/share/doc

Libraries=/usr/lib

Plugins=/usr/lib/qt4/plugins

Translations=/usr/lib/qt4/translations

EOF

sudo mv -v $dir_path/qt.conf $dir_path/qt.conf_backup

sudo mv -v $HOME/qt.conf $dir_path

elif [ -z "$ge" ]; then

echo -e "You don't have Google Earth installed!\n"

exit

exit 0

View Config Files Without Comments

Posted by cviorel on August 10, 2009 No comments | This post has 691 views.

Use this grep invocation to trim comments out of config files. Comments are great but can get in your way if you just want to see the currently running configuration. I’ve found files hundreds of lines long which had fewer than ten active configuration lines.
It’s really hard to get an overview of what’s going on when you have to wade through hundreds of lines of comments.

grep ^[^#] /etc/samba/smb.conf

1	grep ^[^#] /etc/samba/smb.conf

The regex ^[^#] matches the first character of any line, as long as that character that is not a #. Because blank lines don’t have a first character they’re not matched either, resulting in a nice compact output of just the active configuration lines.

Random crash of the X server in Jaunty

Posted by cviorel on May 21, 2009 No comments | This post has 578 views.

I experienced a lot of random X server crashes using the proprietary driver for the NVIDIA graphic card on my Thinkpad T61 running Ubuntu 9.04 x86 with Compiz activated.
I managed to fix the problem by installing the lastest NVIDIA driver. I wrote a little script to automate the process and save time. I recommend you to run this in command line mode. Here it is:

#!/bin/bash

# Check if the X server is running
pid_of_X=`ps aux | grep X | grep -v 'grep' | grep root | awk '{ print $2 }'`

if [ -z "$pid_of_X" ];
  then
    echo -e '\n\n\n\n\n\n\n\n\n'
    echo -e 'X is not running! - Good!\n'
	# Stop the xserver (GDM)
	sudo /etc/init.d/gdm stop
	cd $HOME/Desktop

	if [ -e latest.txt ]; # Check for 'latest.txt' file
	  then
	    rm -f latest.txt
	fi

	if [ -e NVIDIA-Linux-x86-* ]; # Check for 'NVIDIA-Linux-x86-*' file
	  then
	    rm -f NVIDIA-Linux-x86-*
	fi

	# Get the latest driver from NVIDIA's ftp
	nvidia_ftp='ftp://download.nvidia.com/XFree86/Linux-x86'
	wget -c -T 10 $nvidia_ftp/latest.txt

	new_driver_version=`cat latest.txt | awk '{ print $1 }'`
	new_driver_filename=`cat latest.txt | awk '{ print $2 }'`

	wget -c -T 10 $nvidia_ftp/$new_driver_filename

	chmod +x $HOME/Desktop/NVIDIA-Linux-x86-*

	# Remove all nvidia* packages in the system
	sudo dpkg -l | grep nvidia | awk '{ print $2 }' | xargs sudo aptitude -y purge

	# Remove all the nvidia kernel objects currently installed
	export kernel_version=`uname -r`
	sudo rm -f `find /lib/modules/$kernel_version -iname nvidia.ko`

	# Install the new driver
	sudo sh $HOME/Desktop/NVIDIA-Linux-x86-*.run

	rm -f NVIDIA-Linux-x86-*
	rm -f latest.txt

	echo -e '\n\n\n\n\n\n\n\n\n'
	echo -e '---------\n'
	echo -e 'All done!\n'
	echo -e 'Starting GDM in 5 seconds...\n'
	sleep 5

	# Start GDM
	sudo /etc/init.d/gdm start
    
  else
    echo -e '\n\n\n\n\n\n\n\n\n'
    echo -e 'X is running!\n'
    echo -e 'You should run this script in console mode!\n'

    echo -e 'Press CTRL+ALT+F1 to go to console mode, then run this script again!\n'
    echo -e '\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n'
    echo -e 'Aborting in 5 seconds!'
    echo -e '\n\n\n\n\n\n\n\n\n'
    sleep 5
    exit 0
fi

#!/bin/bash

# Check if the X server is running

pid_of_X=`ps aux | grep X | grep -v 'grep' | grep root | awk '{ print $2 }'`

if [ -z "$pid_of_X" ];

then

echo -e '\n\n\n\n\n\n\n\n\n'

echo -e 'X is not running! - Good!\n'

# Stop the xserver (GDM)

sudo /etc/init.d/gdm stop

cd $HOME/Desktop

if [ -e latest.txt ]; # Check for 'latest.txt' file

then

rm -f latest.txt

if [ -e NVIDIA-Linux-x86-* ]; # Check for 'NVIDIA-Linux-x86-*' file

then

rm -f NVIDIA-Linux-x86-*

# Get the latest driver from NVIDIA's ftp

nvidia_ftp='ftp://download.nvidia.com/XFree86/Linux-x86'

wget -c -T 10 $nvidia_ftp/latest.txt

new_driver_version=`cat latest.txt | awk '{ print $1 }'`

new_driver_filename=`cat latest.txt | awk '{ print $2 }'`

wget -c -T 10 $nvidia_ftp/$new_driver_filename

chmod +x $HOME/Desktop/NVIDIA-Linux-x86-*

# Remove all nvidia* packages in the system

sudo dpkg -l | grep nvidia | awk '{ print $2 }' | xargs sudo aptitude -y purge

# Remove all the nvidia kernel objects currently installed

export kernel_version=`uname -r`

sudo rm -f `find /lib/modules/$kernel_version -iname nvidia.ko`

# Install the new driver

sudo sh $HOME/Desktop/NVIDIA-Linux-x86-*.run

rm -f NVIDIA-Linux-x86-*

rm -f latest.txt

echo -e '\n\n\n\n\n\n\n\n\n'

echo -e '---------\n'

echo -e 'All done!\n'

echo -e 'Starting GDM in 5 seconds...\n'

sleep 5

# Start GDM

sudo /etc/init.d/gdm start

else

echo -e '\n\n\n\n\n\n\n\n\n'

echo -e 'X is running!\n'

echo -e 'You should run this script in console mode!\n'

echo -e 'Press CTRL+ALT+F1 to go to console mode, then run this script again!\n'

echo -e '\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n'

echo -e 'Aborting in 5 seconds!'

echo -e '\n\n\n\n\n\n\n\n\n'

sleep 5

exit 0

Auto update for Debian/Ubuntu

Posted by cviorel on May 6, 2009 No comments | This post has 686 views.

I use the following script to automatically update my Ubuntu box.
I don’t recommend using this on your production servers!

#!/bin/bash
 
#################################################
##                                             ##
## auto-update.sh v1.0                         ##
## Use this script to set up automatic updates ##
## on your debian/ubuntu box.                  ##
##                                             ##
#################################################
 
## Creating /usr/bin/auto-update.sh file
sudo touch /usr/bin/auto-update.sh
sudo chmod 700 /usr/bin/auto-update.sh
sudo chown root:root /usr/bin/auto-update.sh
echo '#!/bin/bash' | sudo tee -a /usr/bin/auto-update.sh
echo 'touch /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh
echo 'echo '------------------' >> /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh
echo 'echo `date` >> /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh
echo 'PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/X11R6/bin' | sudo tee -a /usr/bin/auto-update.sh
echo 'export PATH' | sudo tee -a /usr/bin/auto-update.sh
echo '/usr/bin/aptitude update >> /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh
echo '/usr/bin/aptitude -y safe-upgrade >> /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh
echo 'exit' | sudo tee -a /usr/bin/auto-update.sh

# Creating a cron job for root user (it will run /usr/bin/auto-update.sh every day at 14:30)
echo '30 14 * * * /usr/bin/auto-update.sh > /dev/null' > cron_file.txt && sudo crontab -u root cron_file.txt && rm -f cron_file.txt

#!/bin/bash

#################################################

## ##

## auto-update.sh v1.0 ##

## Use this script to set up automatic updates ##

## on your debian/ubuntu box. ##

## ##

#################################################

## Creating /usr/bin/auto-update.sh file

sudo touch /usr/bin/auto-update.sh

sudo chmod 700 /usr/bin/auto-update.sh

sudo chown root:root /usr/bin/auto-update.sh

echo '#!/bin/bash' | sudo tee -a /usr/bin/auto-update.sh

echo 'touch /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh

echo 'echo '------------------' >> /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh

echo 'echo `date` >> /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh

echo 'PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/X11R6/bin' | sudo tee -a /usr/bin/auto-update.sh

echo 'export PATH' | sudo tee -a /usr/bin/auto-update.sh

echo '/usr/bin/aptitude update >> /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh

echo '/usr/bin/aptitude -y safe-upgrade >> /var/log/auto-update.log' | sudo tee -a /usr/bin/auto-update.sh

echo 'exit' | sudo tee -a /usr/bin/auto-update.sh

# Creating a cron job for root user (it will run /usr/bin/auto-update.sh every day at 14:30)

echo '30 14 * * * /usr/bin/auto-update.sh > /dev/null' > cron_file.txt && sudo crontab -u root cron_file.txt && rm -f cron_file.txt

Note that there are some dangers regarding automatic updates. You can read more about it here.

My custom bash prompt (PS1)

Posted by cviorel on October 9, 2008 No comments | This post has 774 views.

Pimp out Linux / UNIX shell prompt!
You can find a nice guide here, and a nice collection here.
Here is mine:

export PS1="[\[\e[28;1m\]\H \[\e[0m\]\w]\$ "

1	export PS1="[\[\e[28;1m\]\H \[\e[0m\]\w]\$ "

Have fun!

Sample firewall script for Ubuntu

Posted by cviorel on May 7, 2008 No comments | This post has 1,110 views.

I just thought that you might be interested in a small script you can use in Hardy Heron.

It uses the new UFW (Uncomplicated firewall) introduced in this new Ubuntu distro.

The script is well commented, so everything is easy to understand.

Here is the script:

#!/bin/bash

  ## set the default policy to drop (deny) all connections
  sudo ufw default deny

  ## set logging ON
  sudo ufw logging on
  
  ## permit unrestricted traffic from a specific static IP address
  sudo ufw allow from 192.168.1.1    # maybe your router

  ## permit TCP connections on ssh port 22
  sudo ufw allow 22/tcp

  ## Allow Apache2
  sudo ufw allow 80/tcp

  ## Allow MySQL
  sudo ufw allow 3306/tcp
  
  ## Allow Bittorrent
  for port in {7881..7889};
  do sudo ufw allow $port/tcp; done

  ## Allow eMule
  sudo ufw allow 4662/tcp
  sudo ufw allow 4672/udp

  ## Allow DC++
  sudo ufw allow 6845
  
  ## Allow Samba from internal network only 
  sudo ufw allow proto tcp from 192.168.1.0/24 to any port 135 # used by smbd
  sudo ufw allow proto udp from 192.168.1.0/24 to any port 137 # used by nmbd
  sudo ufw allow proto udp from 192.168.1.0/24 to any port 138 # used by nmbd
  sudo ufw allow proto tcp from 192.168.1.0/24 to any port 139 # used by smbd
  sudo ufw allow proto tcp from 192.168.1.0/24 to any port 445 # used by smbd

  ## Display rules
  sudo ufw status

#!/bin/bash

## set the default policy to drop (deny) all connections

sudo ufw default deny

## set logging ON

sudo ufw logging on

## permit unrestricted traffic from a specific static IP address

sudo ufw allow from 192.168.1.1 # maybe your router

## permit TCP connections on ssh port 22

sudo ufw allow 22/tcp

## Allow Apache2

sudo ufw allow 80/tcp

## Allow MySQL

sudo ufw allow 3306/tcp

## Allow Bittorrent

for port in {7881..7889};

do sudo ufw allow $port/tcp; done

## Allow eMule

sudo ufw allow 4662/tcp

sudo ufw allow 4672/udp

## Allow DC++

sudo ufw allow 6845

## Allow Samba from internal network only

sudo ufw allow proto tcp from 192.168.1.0/24 to any port 135 # used by smbd

sudo ufw allow proto udp from 192.168.1.0/24 to any port 137 # used by nmbd

sudo ufw allow proto udp from 192.168.1.0/24 to any port 138 # used by nmbd

sudo ufw allow proto tcp from 192.168.1.0/24 to any port 139 # used by smbd

sudo ufw allow proto tcp from 192.168.1.0/24 to any port 445 # used by smbd

## Display rules

sudo ufw status

You can modify it by adding/removing rules accordingly.

Backup your MySQL databases automatically with AutoMySQLBackup

Posted by cviorel on May 6, 2008 No comments | This post has 755 views.

If you are a MySQL user and you want to have a disaster recovery solution, or even as a simple backup, you can write small shell scripts based on mysqldump tool.

For this, you need AutoMySQLBackup. It doesn’t have any real requirements (mysqldump of course is needed – in any mysql client package – and gzip or bzip2 to compress the resulting file) and has all the features I was looking for in such a script.

AutoMySQLBackup has all the features I needed: it can backup a single database, multiple databases, or all the databases on the server; each database is saved in a separate file that can be compressed (with gzip or bzip2); it will rotate the backups and not keep them filling your hard drive (as normal in the daily backup you will have only the last 7 days of backups, the weekly if enabled will have one for each week, etc.). It has also some other features (check the project homepage for full details), that I am not using myself (like email logs for example), but other peoples might find interesting.

All you have to do is to modify a few things:
# Username to access the MySQL server e.g. dbuser USERNAME=dbuser # Username to access the MySQL server e.g. password PASSWORD=password # Host name (or IP address) of MySQL server e.g localhost DBHOST=localhost # List of DBNAMES for Daily/Weekly Backup e.g. "DB1 DB2 DB3" DBNAMES="all" # Backup directory location e.g /backups BACKUPDIR="/var/backup/mysql" # Mail setup MAILCONTENT="quiet"
You can run the script manually but you will want to enable it in cron
and run daily.

HOWTO make DVD and CD .iso images using dd or cat in Linux

Posted by cviorel on March 4, 2008 No comments | This post has 824 views.

Please note that making security backups of your DVD/CD:s may be illegal in your country.

for the purpose of making these backups, the programs you need are standard, *NIX programs, and it is a safe bet that you wont need to install anything.
You may also need to have root permissions in able for you to access the DVD or CD devices.

Heres how to back up the device:

with cat:

cat /dev/dvd0 &gt; ~/image.iso

1	cat /dev/dvd0 > ~/image.iso

with dd:

dd if=/dev/dvd0 of=~/image.iso bs=2048

1	dd if=/dev/dvd0 of=~/image.iso bs=2048

replace /dev/dvd0 with what ever device it is corresponding with your CD/DVD rom player. If you’re unsure, you might find that $ cat /etc/fstab might provide you some useful information.

The two commands above copies the CD rom or DVD to the home folder. Making a image file with the iso 9660 or the Universal Disk Format file system. Please note that neither cat nor dd cares about file system. Dd copies blocks, and cat prints a file to stdout.

I have heard that cat does not copy the mbr record of the devices copied with it, but I know that dd does.

Note that if you’ve made the image file as the root user, you might have to chmod the file, and it might also be nice to change the files ownership

chown youruser:yourgroup ~/image.iso ; chmod 775 ~/image.iso

1	chown youruser:yourgroup ~/image.iso ; chmod 775 ~/image.iso

how to loopback mount the .iso file:

mount -t iso9660 -o loop ~/image.iso /mnt/tmp

1	mount -t iso9660 -o loop ~/image.iso /mnt/tmp

replace iso9660 with udp if your mounting a dvd image.

and how to umount it:

umount /mnt/tmp

1	umount /mnt/tmp

umount ~/image.iso

1	umount ~/image.iso

Page 1 of 2
1
2
>

cviorel.com

Tag Archives: bash

Bash script to backup my configs (dotfiles)

Search and remove duplicate files

Fix Google Earth 5.0 user interface font on Linux

View Config Files Without Comments

Random crash of the X server in Jaunty

Auto update for Debian/Ubuntu

My custom bash prompt (PS1)

Sample firewall script for Ubuntu

Backup your MySQL databases automatically with AutoMySQLBackup

HOWTO make DVD and CD .iso images using dd or cat in Linux

Categories

Tag Archives: bash

Social

Categories

Tags