Course Notices | COMP9313 19T3 | WebCMS3 Toggle navigation WebCMS3 Search Courses Login COMP9313 19T3 Home Course Outline Forums Timetable Groups Activities Course Work Assignments Labs Lectures Lecture Recording Lecture Recordings Toggle Menu COMP9313 Notices Notices Assignment 2 Marking details and inquires Posted by Morty Al-Banna Tuesday 10 December 2019, 07:58:17 PM. Dear All, I will be releasing the detailed marking for assignment 2 tonight (after midnight) when there is less load on the mail server. in the detailed description you will be able to see the mark for each item in the marking scheme and who is the marker so that you can send any inquiry if needed. I have released the total marks and feedback only since I didn't want to wait till midnight when some students might be sleeping and would appreciate the marking before the exam. rest assured that all issues will be resolved and sorry if I have caused any inconvenience for some students. best of luck... Marks for Assignment2 Posted by Morty Al-Banna Tuesday 10 December 2019, 05:09:30 PM. Dear All, sorry for the delay...your Mark for assignment 2 is now available for viewing using 'Classrun' ( https://wiki.cse.unsw.edu.au/give/Classrun ). you'll find some comments as well under (assign2_feedback). the detailed marking will be released soon via e-mail. regards, Morty Code development questions in the final exam Posted by Morty Al-Banna Thursday 05 December 2019, 02:48:22 PM. Dear All, As I mentioned in the final lecture, in the final exam we won't ask you to develop a complete program. there might be some questions including/about snippets of code or pseudo code. You don't need to memorize code syntax. As long as you have done your assignments and the hands-on activities you will be more than qualified to answer these kind of questions. best of luck to all... Morty Final call to participate in MyExeprience Survey Posted by Morty Al-Banna Thursday 28 November 2019, 05:36:51 PM. Dear All, Thanks for the students who have participated in the MyExperience Survey and sorry for receiving multiple e-mails in this regards. Your feedback is really valuable to us and it helps us improve. If you have not participated in the surveys yet, please if you may take some time to do so. Currently we still suffer of very low response rate. You can participate through myUNSW or by clicking the link ( https://myexperience.unsw.edu.au/ ). Please do so ASAP as the survey close today @ 23:59 . thank you... Reminder MyExpreience Survey Posted by Morty Al-Banna Wednesday 27 November 2019, 07:35:51 PM. Dear All, Thanks for the students who have participated in the MyExperience Survey. We will appreciate it for the others who have not participated yet to take some time to participate in the survey as we still have very low response rate. You can participate through myUNSW or by clicking the link ( https://myexperience.unsw.edu.au/ ). Please do so ASAP as the survey close tomorrow (2019-11-28 23:59). thank you.. Final exam Posted by Morty Al-Banna Tuesday 26 November 2019, 12:09:05 PM. Dear All, please if you may login to the link below so that you can check your seat allocation in the final exam. use you zID and password in order to view your seat allocation. Arrive 15 minutes early on the day. http://cgi.cse.unsw.edu.au/~cs9313/19T3/seating/final/register.cgi/allocations if you have any question please feel free to schedule a consultation session. I'm available Wednesday, Thursday and Friday. send me an e-mail on m.al-banna@unsw.edu.au to set the meeting. regards, Quiz5 deadline extended Posted by Morty Al-Banna Sunday 24 November 2019, 11:33:11 PM. Dear all, We have extended Quiz5 deadline. please submit your answer before 6:00 PM tomorrow. best of luck Quiz submission problem Posted by Morty Al-Banna Wednesday 20 November 2019, 05:10:20 PM. Dear All, There seems to be a problem with the quiz module in WebCMS. I have already reported this to the developer. In the mean time you can use Google Chrome Browser to submit the quiz as it seems that this has worked for some other students. best of luck Assignments 1 feedback related email Posted by Maisie Badami Wednesday 20 November 2019, 01:25:51 PM. Hi There For a quicker and better respond to emails related to assignment 1 result, please make sure that you are emailing directly to the tutor who marked your assignment and make sure that your short email contains your Zid. Thanks, Maisie Quiz5 is released Posted by Morty Al-Banna Monday 18 November 2019, 01:06:48 AM. Dear All, Quiz5 is released in the activity section. Best of luck, Assignment 2 deadline extended Posted by Morty Al-Banna Saturday 16 November 2019, 10:41:47 AM, last modified Monday 18 November 2019, 11:57:05 PM. Dear All, We have extended the deadline for Assignment 2 to be Tuesday the 19th of November 2019 17:59 Thursday the 21st of November 2019 17:59 also and in order to manage the marking for assignment 2 a bit early, the late penalty is now: 20% reduction of your marks for the 1st day, 40% reduction/day for the following days Best of luck to all... Elasticsearch tutorial material Posted by Maisie Badami Thursday 14 November 2019, 03:58:23 PM. Hi There Please find the following material for the Elasticsearch tutorial session this afternoon (14/11/2019 at 6:00 pm) 1.Open Eclipse: If you use the lab computer, you can find it in Applications Menu -> Development -> Eclipse. 2.Choose a workspace (which is a workspace for your project) 3.Please check the Maven: If Maven plugin is not installed in Eclipse, you can install it from using Eclipse Marketplace (skip the steps in bullets if Maven is already installed and go directly to step 4) Go to Help > Install New Software Paste the Marketplace Client update site URL into the “Work with” field: http://download.eclipse.org/mpc/photon Select the “EPP Marketplace Client” checkbox Follow the wizard and restart your Eclipse to finish the installation. 4.Start a new project, choose a Maven project All the best Maisie Assignment 2 - Frequent Questions Posted by Maisie Badami Saturday 09 November 2019, 05:42:40 PM. Hi There These are some of the most asked questions in the forum about assignment 2 , hope these answers can clear some of the confusions: 1. Please note that you don't need to save the output of your code into a file with a specific name, the default name is fine( e.g., part-00000) 2. We will not test your program on a huge dataset , so you don't need to spend time on the performance of your code on huge dataset 3. You can use temp files to collect RDD 's results and use it in the next one. Best of luck Maisie Assignment 2 released Posted by Morty Al-Banna Saturday 02 November 2019, 09:34:43 PM. Dear All, Assignment 2 specifications are released now in the Assignments subsection best of luck to all... Quiz 4 deadline Posted by Morty Al-Banna Wednesday 30 October 2019, 12:33:46 PM. Dear All, it seems that by mistake I've put the deadline of Quiz4 to be 8AM while it should be 8PM. the quiz is opened now if you want to submit your answer. regards Assignment 1 deadline extended Posted by Morty Al-Banna Monday 28 October 2019, 12:17:39 PM. Dear All, We have extended the deadline for Assignment 1 to be Tuesday the 29th of October 2019 17:59 Best of luck to all... Quiz 4 released Posted by Morty Al-Banna Friday 25 October 2019, 01:10:19 PM. Dear All, Quiz 4 is released in the actvitvy section. regards Use of Writables in Assignment 1 Posted by Mohammadali Yaghoubzadehfard Thursday 24 October 2019, 04:20:39 PM, last modified Thursday 24 October 2019, 05:02:47 PM. Here is the clarification about how you will be marked regarding custom writables: Use of ArrayWritables is optional as long as it is used for keeping a list of writable objects (do not use it for keeping a pair (movie, movie), or a triple (user, rating, rating). Use of MapWritable or Text to keep complex objects or list of objects will result in loss of marks: (e.g., do not use text like new Text("User"+","+Rating_1 + ","+ Rating_2)) It is up to you (and part of assessment) to implement custom writables in an efficient manner (with minimal memory wasting) Deadline for Assignment 1 change Posted by Morty Al-Banna Tuesday 22 October 2019, 12:45:48 PM. Dear All, it came to our attention that some students tend to stay in CSE labs right up to the deadlines and hence it might cause these students to leave campus after midnight. This can make things less convenient and safe. for Assignment 1 please be advised that the new deadline is now Monday 28th of October 2019, 17:59. Best regards, Quiz 3 released Posted by Morty Al-Banna Friday 18 October 2019, 02:02:50 AM. Dear All, Quiz 3 is released in the actvitvy section Best of luck Google Cloud credit Coupons Posted by Morty Al-Banna Thursday 17 October 2019, 02:52:48 PM, last modified Friday 18 October 2019, 01:24:17 AM. Dear All, Here is the URL you will need to access in order to request a Google Cloud Platform coupon. You will be asked to provide your school email address and name. An email will be sent to you to confirm these details before a coupon is sent to you. Student Coupon Retrieval Link You will be asked for a name and email address, which needs to match the domain. A confirmation email will be sent to you with a coupon code. You can request a coupon from the URL and redeem it until: 1/15/2020 Coupon valid through: 9/15/2020 You can only request ONE code per unique email address. Try to acvtivate your account before the lecture if you want to follow up with the activity today. Please contact me if you have any questions or issues. Thanks, The marking scheme for assignment 1 Posted by Maisie Badami Wednesday 16 October 2019, 05:01:43 PM, last modified Wednesday 16 October 2019, 08:41:12 PM. Hello all, Please find the marking scheme for assignment #1 as below : Regards Maisie 1. The output is generated by Hadoop MapReduce correctly (7 Marks) 2. The output is formatted correctly as described in the spec (2 marks) Format must be the same as (M2,M3) [(U5,3,3),(U2,3,1)] There should be no empty list like: (M2,M3) [] 3.Custom Writables are well defined (e.g., appropriate data-types have been used without wasting memory) (4 marks) 4. The code could be executed in CSE machines as described in the specification of the assignment (2 Marks) 5. The maximum number of Mappers and Reducers is 2 (2 Mappers and 2 Reducers) (2 Marks) 6. Documentation (3 Marks) A couple of notes to consider: The documentation needs to be written in one paragraph ( max of 300 words), this paragraph should be located at the beginning of the code as a commentary. The documentation is to address how the problem been addressed and solved, please avoid repeating general concept of coding ( such as what is a mapper or a reducer in general), try to be descriptive and explain your code. Please avoid hard-coding the input and output path of your in your code. Assignment-1 Disk Issues Posted by Mohammadali Yaghoubzadehfard Monday 14 October 2019, 07:26:58 PM. Dear all, If you are facing any disk quote issue, please cut the dataset when you are testing. For example, in linux you can only keep first 1000 rows: $ head -n 1000 dataset.txt > new_dataset.txt You can also manually create a fake dataset to test your code on instead of the large dataset. Cheers, Assignment 1 released Posted by Morty Al-Banna Friday 11 October 2019, 10:59:03 PM. Dear all, assignment 1 specification is released. Best of luck... Quiz 2 released Posted by Morty Al-Banna Monday 07 October 2019, 01:48:42 AM. Dear all, Quiz 2 is release in the activity section best of luck Lab #1 guideline for week 4 is released. Posted by Maisie Badami Friday 04 October 2019, 08:11:34 AM. Hi All, Lab guideline for week 4 is now available under Labs --> week 4 Good luck Maisie Hands-on activity in tomorrow lecture time Posted by Morty Al-Banna Wednesday 02 October 2019, 05:43:26 PM, last modified Wednesday 02 October 2019, 06:06:55 PM. Dear All, tomorrow (Thursday lecture time) We are going to have a hands-on activity about Hadoop. Try to bring your laptops with you in order to be able to participate and walk-through the activity yourself. Due to the large number of students we'll try to keep the activity going within the time limit of the lecture and you are at liberty to carry-on and ask for support on the labs that are starting Week4. You can also utilize WebCMS forum for questions. P.S. for students enrolled in Web streaming the lecture is recorded as usual and we'll release the document as well so that you can do the activity on your own time and/or come to the labs for support and debugging. regards, Morty Java refresher additional session Posted by Morty Al-Banna Monday 30 September 2019, 10:44:52 PM. Dear All, as both the remaining lab sessions for Java refreshing are fully booked so I want to gauge how many people are interested and didn't have the chance to participate/reserve a spot in one the sessions. if you are not interested in this, then stop reading and just ignore this announcement. if you are interested, please participate in the Poll ( https://webcms3.cse.unsw.edu.au/COMP9313/19T3/activities/polls/1191 ) and indicate this. please be advised that the material presented would be the same for the other sessions. regards, Morty Java labs enrolment lists Posted by Maisie Badami Monday 30 September 2019, 04:15:46 PM, last modified Monday 30 September 2019, 04:31:04 PM. Hi There Please look up your name or zid from the following list and just attend in the lab that you are allocated to Please note that no changes would be possible in terms of swapping the days. Best, Maisie Java lab Tuesday session :
Name Zid CHONGSHI WANG z5190861 Yingdong Hao z5188674 Jeremy Fu z5059293 Muhammad Ouaida z5157566 Lujing Cui z5038596 Edwin Choi z5021028 Qingyuan CAO z5201868 Yu Liu z5190675 Elakkiya Narayanasamy Ramarajan z5239345 Chirag Panikkasseril Unn z5241855 Ruijun Zhou z5223541 SHUAI JI Z5189630 ZIHANG WANG Z5203852 Yuliang Wang z5191313 Jiacheng Yue z5134216 Zhu YiLin z5173788 Peilie Yang z5005134 Daifei Zhang z5185668 Ziqiang Wang Z5236374 Fuyu Yang z5220716 Haotian Chu Z5188746 Sebastian Castillo Castro z5171921 Young Jae Lee z5077151 Lei Cao z5170034 Zhihao Zhang z5198066 Java Lab Wednesday session : Name Zid Chencheng Xie z5237028 Chenghe Wu Not provided Gaganjot Singh z5225770 Jagadish Raghavan z5226835 jiabin Wang z5233400 Jiawen Tian z5217214 Keyue (Corina) Chen Z5118831 Marc Medhat Mounier Ishak z5165902 MINGKAI ZHANG z5193723 Sangeetha Ravisankar z5215702 Shiyi Yang z5223292 Shuang Liang z5187272 Songxue Wang z5172835 Tao Xue z5219280 xujie,li z5192211 Yanchao Liu z5144388 Yu Zhang z5200177 Zhao Yao z5196362 Horace Pang z5023137 Shaowei Ma Not provided Longcheng Zhao z5227264 Ziming wang z5140944 Hao Xi z3267502 Wang YU z5204026 Fa Liu Not provided The Java lab enrolment is now closed Posted by Maisie Badami Monday 30 September 2019, 02:20:16 PM. Hi All Thanks all for showing interest for attending the Java refresher labs, now we reached the 50 enrolments and can't enrol more. We may set up another session, if we find that there are more students interested, although this depends on the approval from the school, so stay tune. Please do not send further email regarding to the previous announcement, as the emails won't be attended. The attendees list will be posted here shortly Thanks Maisie Java labs this week Posted by Maisie Badami Monday 30 September 2019, 10:12:09 AM, last modified Monday 30 September 2019, 10:48:33 AM. Dear All, Due to the high attendance in the first round of our Java refresher lab, we decided to take enrollment for who are interested in attending the next two sessions on the following dates. Each lab is limited to 25 ppl, first-in-first served, please note that the content of the labs are the same and you don't need to attend all the sessions. Please email me on m.badami@unsw.edu.au , with your full name and zID , the first 25 emails will attend the Tuesday session and second 25 will attend the Wednesday session. I will annonce here when we reach the 50 emails. Tue 01/10/2019 14:00 16:00 Kora Wed 02/10/2019 14:00 16:00 Drum Thanks, Maisie Quize 1 released Posted by Morty Al-Banna Friday 27 September 2019, 11:38:27 PM. Dear all, Quiz 1 is released in the activity section ( https://webcms3.cse.unsw.edu.au/COMP9313/19T3/activities/ ) have a nice weekened... Java for Big Data Labs Posted by Morty Al-Banna Wednesday 25 September 2019, 02:47:11 AM. Dear All, for those who are interested in refreshing their Java Knowledge we will be running three labs for this purpose. Thu 26/09/2019 16:00 to 18:00 Sitar Tue 01/10/2019 14:00 16:00 Kora Wed 02/10/2019 14:00 16:00 Drum Please be advised that as COMP9313 is not a programming language learning course so these labs are meant for refreshing your knowledge and provide support if needed. in Week 4 we start with Labs and activities about Hadoop. best regards, Morty Welcome to COMP9313 Posted by Morty Al-Banna Monday 16 September 2019, 02:23:12 AM. Dear All, Welcome to COMP9313 (Big Data Management). Please be advised that for Week 1 there are no Labs. You can make use of the time to refresh your Java Knowledge as we are going to rely on it as the programming language of choice. here are some useful tutorials: if you are a beginner or need a quick revision then these two are useful https://www.codecademy.com/learn/learn-java https://www.sololearn.com/Course/Java/ then you can advance further by learning by doing with this one: https://www.udemy.com/course/practice-java-by-building-projects/ Looking forward to seeing you in the first lecture on Tuesday... regards, Morty Back to top COMP9313 19T3 (Big Data Management) is powered by WebCMS3 CRICOS Provider No. 00098G 
