Skrypt do tworzenia plików – linux, python

Potrzebny jest python w wersji 2.6+ (<3)

Tworzenie 4mln plików z krótką, renderowaną zawartością:
python createFile.py 4000000


============================================================================
#!/usr/bin/python
import sys
import os
import uuid

katalogPoczatkowy="Katalog docelowy"

print "Tworze " + sys.argv[1] + " plikow, po max 1.000 w katalogu"

petla=0   #aktualna petla
katalog=0  #aktualny katalog
petlaWKatalogu=0   #aktualna petla w katalogu
dir=""   #aktualny katalog

ilosc=int(sys.argv[1])  #calkowita ilosc w pliku
print type(ilosc)

while petla < ilosc:
        if petla%1000==0:
                katalog=katalog+1
                dir=katalogPoczatkowy + str(katalog)
                if not os.path.exists(dir):
                        os.makedirs(dir)
        #print "Zakladam plik", dir, petla
        file=dir + "/" + str(petla)
        with open(file,"a") as thefile:
                thefile.write(str(uuid.uuid4())[:8])
        petla=petla+1
============================================================================

~


----------------------------------------------
**********************************************

Uruchamianie: python createFile.py 4000000

----------------------------------------------
**********************************************


Używaj tego skryptu na własną odpowiedzialność!!!!

Jeśli nie masz pythona, prosty skrypt bash na stworzenie losowych plików – o tej samej wielkości:

 for (( c=3; c<10000; c++ )); \\
do dd if=/dev/urandom of=file$c.random bs=1024 \\
count=1024 2>/dev/null; done;

        
No Comments

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Linux
Creating random (not empty, thin provisioned) files in Linux

Recently I have found the command that can generate random file in linux environment where non empty (thin provisioned) files are required for testing: todo: combine that command with parallel command (or parallel that in python).

Linux
Nginx configuration for joplin note taking app

Introduction Joplin may not be the most perfect note-taking application, but it is open-source, well-known, has a long release history, works on multiple operating systems, and supports plugins. It’s not perfect, but it’s good enough and highly usable. In case of this type of application, it is important to have …

Linux
podcast

All podcast applications I have tested were quite OK(ish) – but I have always struggled with organizing podcasts, creating playlists, etc. It has always been challenging. Therefore, for me, it is more convenient to download podcasts as MP3s and manage them myself (in VLC, for example). There are many ways to do that, but my favorite …