MNIST / Fashion MNIST image data The main objective is to write a fully executed R-Markdown program performing clustering using DBSCAN and Mixture model on the MNIST / Fashion MNIST (apparel) images that are 28 x 28 pixels resolution. Make sure to describe the final hyperparameter settings of all algorithms that were used for comparison purposes. You are required to clearly display and explain the models that were run for this task and their effect on the reduction of the Cost Function. Points will be deducted in case you fail to explain the output. MNIST / Fashion MNIST image data The main objective is to write a fully executed R-Markdown program performing clustering using DBSCAN and Mixture model on the MNIST / Fashion MNIST (apparel) images that are 28 x 28 pixels resolution. Make sure to describe the final hyperparameter settings of all algorithms that were used for comparison purposes. You are required to clearly display and explain the models that were run for this task and their effect on the reduction of the Cost Function. Points will be deducted in case you fail to explain the output.

Research Project This information was first posted in Week 10 and is now due this week. You are the IT manager of a large corporation. You are planning to use Python to develop statistical models to aid in analyzing your sales data. You are preparing a report for management. Here are the basic requirements for your report: • Prepare in APA format • Include references • Report length: 500 - 700 words • Briefly describe your company • Briefly describe Python • Give overview of Machine Learning • Report on:' • Implementation plans • Technical training • Python libraries required • How Python will be used • Types of reports that will be produced In addition, prepare a PPT presentation related to your Research Project. You will be required to have this ppt prepared for presentation at residency. Research Project This information was first posted in Week 10 and is now due this week. You are the IT manager of a large corporation. You are planning to use Python to develop statistical models to aid in analyzing your sales data. You are preparing a report for management. Here are the basic requirements for your report: • Prepare in APA format • Include references • Report length: 500 - 700 words • Briefly describe your company • Briefly describe Python • Give overview of Machine Learning • Report on:' • Implementation plans • Technical training • Python libraries required • How Python will be used • Types of reports that will be produced In addition, prepare a PPT presentation related to your Research Project. You will be required to have this ppt prepared for presentation at residency.

Describe the main difference between k-means clustering and hierarchical clustering, and a business use case of these algorithms. The initial post must be between 250-300 words in length and is due by 11:59PM EST in your timezone on Thursday. At least two replies to other students are due by Sunday at 11:59PM EST in your timezone. Responding to at least two other students is a requirement; posts must be submitted on time and each peer reply per question must be between 150-200 words in length. Describe the main difference between k-means clustering and hierarchical clustering, and a business use case of these algorithms. The initial post must be between 250-300 words in length and is due by 11:59PM EST in your timezone on Thursday. At least two replies to other students are due by Sunday at 11:59PM EST in your timezone. Responding to at least two other students is a requirement; posts must be submitted on time and each peer reply per question must be between 150-200 words in length.

Write a fully executed R-Markdown program and submit a pdf file solving and answering questions listed below under Problems at the end of chapter 15. For clarity, make sure to give an appropriate title to each section. Problem 1: University Rankings (a, b, c, d, f) Problem 4: Marketing to frequent fliers (a, c, d, e, f) Write a fully executed R-Markdown program and submit a pdf file solving and answering questions listed below under Problems at the end of chapter 15. For clarity, make sure to give an appropriate title to each section. Problem 1: University Rankings (a, b, c, d, f) Problem 4: Marketing to frequent fliers (a, c, d, e, f)

Write a brief summary of various tools and techniques you learnt during this course. Which techniques do you see yourself using in the near future? Write a brief summary of various tools and techniques you learnt during this course. Which techniques do you see yourself using in the near future?

Requirements for Discussion Assignments Compose a well-developed post (< 100 words) that is comprehensive in answering questions posed on the discussion board Complete the post by Thursday at 11:59 p.m. ET in the assigned week Demonstrate integration of the required reading, other course materials, critical thinking, scholarly or peer-reviewed sources (as applicable), using either APA or MLA style, depending on the instructor/assignment specifications Save text often when writing lengthy discussion board posts; work can be lost if the Internet connection drops or times out. Write posts offline in a word-processing software first so that the text can be saved. Then copy and paste the text into the discussion thread. Be aware that the format may change when copy and paste is used. Plagiarism: According to the Council of Writing Program Administrators, “Plagiarism occurs when a writer deliberately uses someone else’s language, ideas, or other original (not common-knowledge) material without acknowledging its source.”[1] Any of these activities constitutes plagiarism: directly copying and pasting from a source without citation; paraphrasing from a source or sources without citation; turning in a paper, or sections of a paper, known to be written by someone other than the student; unauthorized multiple submissions of the same work in more than one course; and turning in a purchased paper. [1] Council of Writing Program Administrators. 2003. Defining and Avoiding Plagiarism: The WPA Statement on Best Practices. http://wpacouncil.org/files/wpa-plagiarism-statement.pdf Requirements for Discussion Assignments Compose a well-developed post (< 100 words) that is comprehensive in answering questions posed on the discussion board Complete the post by Thursday at 11:59 p.m. ET in the assigned week Demonstrate integration of the required reading, other course materials, critical thinking, scholarly or peer-reviewed sources (as applicable), using either APA or MLA style, depending on the instructor/assignment specifications Save text often when writing lengthy discussion board posts; work can be lost if the Internet connection drops or times out. Write posts offline in a word-processing software first so that the text can be saved. Then copy and paste the text into the discussion thread. Be aware that the format may change when copy and paste is used. Plagiarism: According to the Council of Writing Program Administrators, “Plagiarism occurs when a writer deliberately uses someone else’s language, ideas, or other original (not common-knowledge) material without acknowledging its source.”[1] Any of these activities constitutes plagiarism: directly copying and pasting from a source without citation; paraphrasing from a source or sources without citation; turning in a paper, or sections of a paper, known to be written by someone other than the student; unauthorized multiple submissions of the same work in more than one course; and turning in a purchased paper. [1] Council of Writing Program Administrators. 2003. Defining and Avoiding Plagiarism: The WPA Statement on Best Practices. http://wpacouncil.org/files/wpa-plagiarism-statement.pdf

Write at least 500 words discussing how text mining could be use to evaluate teachers. Use at least three sources. Include at least 3 quotes from your sources enclosed in quotation marks and cited in-line by reference to your reference list. Example: "words you copied" (citation) These quotes should be one full sentence not altered or paraphrased. Cite your sources using APA format. Use the quotes in your paragraphs. Write in essay format not in bulleted, numbered or other list format. Write at least 500 words discussing how text mining could be use to evaluate teachers. Use at least three sources. Include at least 3 quotes from your sources enclosed in quotation marks and cited in-line by reference to your reference list. Example: "words you copied" (citation) These quotes should be one full sentence not altered or paraphrased. Cite your sources using APA format. Use the quotes in your paragraphs. Write in essay format not in bulleted, numbered or other list format.

Week Thirteen Assignment Using the tweet files from the previous week: 1. Create time series charts for each tweeter showing how word usage has changed over time. Show for three words. You may have to manipulate a parameter to show Comment your code, line by line. 2. Show a graph for each tweeter revealing the ten words with the highest number of retweets. Comment your code, line by line. Submit one document with screenshots of your work in R Studio. Include a slice of your desktop with your screenshots. Week Thirteen Assignment Using the tweet files from the previous week: 1. Create time series charts for each tweeter showing how word usage has changed over time. Show for three words. You may have to manipulate a parameter to show Comment your code, line by line. 2. Show a graph for each tweeter revealing the ten words with the highest number of retweets. Comment your code, line by line. Submit one document with screenshots of your work in R Studio. Include a slice of your desktop with your screenshots.

Write at least 500 words comparing and contrasting Spark and MapReduce for working with Hadoop. Use at least three sources. Include at least 3 quotes from your sources enclosed in quotation marks and cited in-line by reference to your reference list. Example: "words you copied" (citation) These quotes should be one full sentence not altered or paraphrased. Cite your sources using APA format. Use the quotes in your paragraphs. Write in essay format not in bulleted, numbered or other list format. Write at least 500 words comparing and contrasting Spark and MapReduce for working with Hadoop. Use at least three sources. Include at least 3 quotes from your sources enclosed in quotation marks and cited in-line by reference to your reference list. Example: "words you copied" (citation) These quotes should be one full sentence not altered or paraphrased. Cite your sources using APA format. Use the quotes in your paragraphs. Write in essay format not in bulleted, numbered or other list format.

Week Thirteen Assignment: 1. Download and get started with Hortonworks Sandbox. 1. install Virtual Box or VMware or another virtual machine 2. Learn the ropes of the HDP Sandbox. 1. Map Sandbox IP to your Desired Hostname in Hosts File. 2. test browser connection to HDP 3. SSH into HDP (change password). 4. test file transfer 5. Show the HDP splash page Submit one Word document with any screenshots of your work in R Studio. Include a slice of your desktop with your screenshots. Always repeat the question you are answering. Week Thirteen Assignment: 1. Download and get started with Hortonworks Sandbox. 1. install Virtual Box or VMware or another virtual machine 2. Learn the ropes of the HDP Sandbox. 1. Map Sandbox IP to your Desired Hostname in Hosts File. 2. test browser connection to HDP 3. SSH into HDP (change password). 4. test file transfer 5. Show the HDP splash page Submit one Word document with any screenshots of your work in R Studio. Include a slice of your desktop with your screenshots. Always repeat the question you are answering.