Skip to content

Assignment #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
eternal-loading-screen wants to merge 8 commits into
base: main
Choose a base branch
from
Open

Assignment #4

Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
e976b55
delete ip logs... WARNING UNTESTED!
dtxe Nov 15, 2024
ea20676
initialize README file with company name
dtxe Nov 15, 2024
1b28b5b
almost done the assignment
eternal-loading-screen Apr 12, 2025
e2b7b18
Merge branch 'coworker-changes' of https://github.com/UofT-DSI/shell …
eternal-loading-screen Apr 12, 2025
332ba6d
Merge branch 'main' into assignment
eternal-loading-screen Apr 12, 2025
eae4127
Forced commit
eternal-loading-screen Apr 12, 2025
34f3ad9
redo
eternal-loading-screen Apr 12, 2025
f0f8e14
redoing the assignment
eternal-loading-screen Apr 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
72 changes: 67 additions & 5 deletions 02_activities/assignments/assignment.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,34 +11,96 @@ set -x

mkdir analysis output
touch README.md
echo "# Project Name: DSI Consulting Inc." > README.md
touch analysis/main.py

# remove everything from the current directory
# mentioned during office hours
# rm -rf *

# download client data
# downloads data from Github
curl -Lo rawdata.zip https://github.com/UofT-DSI/shell/raw/refs/heads/main/02_activities/assignments/rawdata.zip
# unzips data
unzip -q rawdata.zip
# made change here from class office hours
#unzip -0 -q rawdata.zip
unzip -oq rawdata.zip

###########################################
# Complete assignment here
# Reference guide: https://github.com/UofT-DSI/shell/blob/main/01_materials/bash_quick_reference.md

# $ before each command?

# 1. Create a directory named data
echo Creating Directory
mkdir data
# 2. Move the ./rawdata directory to ./data/raw

# 2. Move the ./rawdata directory to ./data/raw
# 2a. Create the new directory
# mkdir ./data/raw
# 2b. Moving the directory so it can be moved
# cd ./data/raw
echo moving directory
mv rawdata ./data/raw
# 3. List the contents of the ./data/raw directory
ls data/raw

# 4. In ./data/processed, create the following directories: server_logs, user_logs, and event_logs
# 4a create a new directory because this is a new folder; And it'll act as a parent directory / folder
echo Creating Directory
# mkdir ./data/processed
# 4b. navigate to the new directory
# cd ./data/processed
# 4c. create the following directories
# mkdir server_logs user_logs event_logs

# 4d. recreate the folders again > not sure why the autograder is rejecting?

mkdir -p data/processed/{server_logs,user_logs,event_logs}


# 5. Copy all server log files (files with "server" in the name AND a .log extension) from ./data/raw to ./data/processed/server_logs

# 5. Copy all server log files (files with server in the name AND a .log extension) from ./data/raw to ./data/processed/server_logs
# 5a. Change directory
# cd ..
# pwd
# 5b. Copy data
echo Copying data
cp ./data/raw/*server*.log ./data/processed/server_logs
#cp ./data/raw/*.log ./data/processed/server_logs

#cp ./data/raw/rawdata/*server* data/processed/server_logs
#cp ./data/raw/rawdata/*.log data/processed/server_logs


# Q6
# 6. Repeat the above step for user logs and event logs
# Assuming we are copying the contents of the user and event log folders > HW note
# 6a. move contents - meaning not copying
cp ./data/raw/*user*.log ./data/processed/user_logs
cp ./data/raw/*event*.log ./data/processed/event_logs

# 7. For user privacy, remove all files containing IP addresses (files with ipaddr in the filename) from ./data/raw and ./data/processed/user_logs
# 7a. remove files
rm ./data/raw/*ipaddr*
rm -f ./data/processed/user_logs/*ipaddr*
# 7. For user privacy, remove all files containing IP addresses (files with "ipaddr" in the filename) from ./data/raw and ./data/processed/user_logs
rf -rf ./data

# 8. Create a file named ./data/inventory.txt that lists all the files in the subfolders of ./data/processed
# 8a. create file
# look for any file type in the processed directory and put it into the inventory text file
find data/processed -type f > data/inventory.txt

# touch ./data/inventory.txt

###########################################
# # 8b. show all files in the subfolders
# ls -R

# # 8c. add all the data into the inventory text file
# ls -R >> ./data/inventory.txt

###########################################g

echo "Project setup is complete!"
echo Project setup is complete!