BRM Homework: R Studio Assignment Help

R Studio Assignment Help:

• This Is A Group Assignment. • Upload Your Assignment To Moodle By The Indicated Deadline As A Single PDF Document Which Includes A Cover Page, All Relevant R Code And Output, As Well As Your Own Answers. Upload Also The R Code File You Used. (PLEASE DO NOT Print And Hand In Your Assignment Neither To Me Nor To João Azambuja Nor To João Monteiro). • You Will Also Need To Submit Your Model In Kaggle (As Explained Below And In Question 8). • Only ONE Of The Members Of The Group Should Upload The Assignment. • Do Not Forget To Include The Names And Student Numbers Of All Group Members. • The Document’s Presentation Counts. Criteria: • Use A Uniform Typeset And Spacing. • Some Questions Have A Line-Limit Or A Plot-Limit. If You Fail To Respect These Limits, You Will Be Penalized. • The Homework Has A Page Limit. This Page Limit Includes The Cover Page, All Relevant R Code And Output, As Well As Your Own Answers. If You Fail To Respect This Limit, You Will Be Penalized. • Include All Relevant R Code And Output (Only Include Relevant Code And Output). • Code And Output Segments Should Be Well Identified. Use Mono-Spaced Font Such As Courier New For Code Sections. • Answer Each Question In The Appropriate Order And Comment On Your Results. Answers That Consist Only Of The R Output Will Not Be Considered. • No Bindings Or Covers Or Color Printing Are Necessary. Deadline: Saturday, November 19th At 11 Pm. Page Limit: 20 Pages Late Submission Penalties: • 1 Day Delay: - 4 Points (Maximum Grade 16) • 2 Days Delay: - 8 Points (Maximum Grade 12) • 3 Days Delay: - 10 Points (Maximum Grade 10) Pricing Houses Ask A Home Buyer To Describe Their Dream House, And They Probably Won’t Begin With The Height Of The Basement Ceiling Or The Proximity To An East-West Railroad. In This Competition We Will Use A Dataset With 79 Explanatory Variables Describing (Almost) Every Aspect Of Residential Homes In Ames, Iowa, To Predict The 1 Final Price Of Each Home. We Will Use A Version Of The Ames Housing Dataset Compiled By Dean De Cock For Use In Data Science Education. In Order To Download The Data Set, You Must Register At Inclass.Kaggle.Com Using Your @Ucp.Pt Or @Clsbe.Lisboa.Ucp.Pt E-Mail Address. You Can Find The Competition Page At: Https://Inclass.Kaggle.Com/C/ Brm-Predicting-House-Prices Dataset Description Here’s A Brief Version Of What You’ll Find In The Data Description File. SalePrice - The Property’s Sale Price In Dollars. This Is The Target Variable That You’re Trying To Predict. MSSubClass: The Building Class MSZoning: The General Zoning Classification LotFrontage: Linear Feet Of Street Connected To Property LotArea: Lot Size In Square Feet Street: Type Of Road Access Alley: Type Of Alley Access LotShape: General Shape Of Property LandContour: Flatness Of The Property Utilities: Type Of Utilities Available LotConfig: Lot Configuration LandSlope: Slope Of Property Neighborhood: Physical Locations Within Ames City Limits Condition1: Proximity To Main Road Or Railroad Condition2: Proximity To Main Road Or Railroad (If A Second Is Present) BldgType: Type Of Dwelling HouseStyle: Style Of Dwelling OverallQual: Overall Material And Finish Quality OverallCond: Overall Condition Rating YearBuilt: Original Construction Date YearRemodAdd: Remodel Date RoofStyle: Type Of Roof RoofMatl: Roof Material Exterior1st: Exterior Covering On House Exterior2nd: Exterior Covering On House (If More Than One Material) MasVnrType: Masonry Veneer Type MasVnrArea: Masonry Veneer Area In Square Feet ExterQual: Exterior Material Quality ExterCond: Present Condition Of The Material On The Exterior 2 Foundation: Type Of Foundation BsmtQual: Height Of The Basement BsmtCond: General Condition Of The Basement BsmtExposure: Walkout Or Garden Level Basement Walls BsmtFinType1: Quality Of Basement Finished Area BsmtFinSF1: Type 1 Finished Square Feet BsmtFinType2: Quality Of Second Finished Area (If Present) BsmtFinSF2: Type 2 Finished Square Feet BsmtUnfSF: Unfinished Square Feet Of Basement Area TotalBsmtSF: Total Square Feet Of Basement Area Heating: Type Of Heating HeatingQC: Heating Quality And Condition CentralAir: Central Air Conditioning Electrical: Electrical System 1stFlrSF: First Floor Square Feet 2ndFlrSF: Second Floor Square Feet LowQualFinSF: Low Quality Finished Square Feet (All Floors) GrLivArea: Above Grade (Ground) Living Area Square Feet BsmtFullBath: Basement Full Bathrooms BsmtHalfBath: Basement Half Bathrooms FullBath: Full Bathrooms Above Grade HalfBath: Half Baths Above Grade Bedroom: Number Of Bedrooms Above Basement Level Kitchen: Number Of Kitchens KitchenQual: Kitchen Quality TotRmsAbvGrd: Total Rooms Above Grade (Does Not Include Bathrooms) Functional: Home Functionality Rating Fireplaces: Number Of Fireplaces FireplaceQu: Fireplace Quality GarageType: Garage Location GarageYrBlt: Year Garage Was Built GarageFinish: Interior Finish Of The Garage GarageCars: Size Of Garage In Car Capacity GarageArea: Size Of Garage In Square Feet GarageQual: Garage Quality GarageCond: Garage Condition 3 PavedDrive: Paved Driveway WoodDeckSF: Wood Deck Area In Square Feet OpenPorchSF: Open Porch Area In Square Feet EnclosedPorch: Enclosed Porch Area In Square Feet 3SsnPorch: Three Season Porch Area In Square Feet ScreenPorch: Screen Porch Area In Square Feet PoolArea: Pool Area In Square Feet PoolQC: Pool Quality Fence: Fence Quality MiscFeature: Miscellaneous Feature Not Covered In Other Categories MiscVal: $Value Of Miscellaneous Feature MoSold: Month Sold YrSold: Year Sold SaleType: Type Of Sale SaleCondition: Condition Of Sale Questionaire 1. (12.5 Points) Explore The Data Set And Obtain Descriptive Statistics. Your Analysis Should Be Aimed At Understanding How The Housing Market Works. Tell Us A Compeling Story That You Derive Based On Data. You Should Chose One Single Plot To Tell Your Story. Also You Should Write At Most 20 Lines Of Text, Excluding Plots And Tables. 2. (10 Points) One Thing To Test When Building A Predictive Model Is Whether Your Sample Is Affected By Outliers. Although Outliers Are Rare, They Can Have A Significant Impact On Your Models Predictive Performance. Investigate The SalesPrice Variable For Outliers. What Do You Find? Also You Should Write At Most 15 Lines Of Text, Excluding Plots And Tables. 3. (7.5 Points) Another Thing To Deal With When Building A Predictive Model Is Missing Data. How Many Variables In Your Data Have Missing Data? How Many Observations Are Affected? What Can You Do About It? Also You Should Write At Most 10 Lines Of Text, Excluding Plots And Tables. 4. (15 Points) Build A Model To Predict SalePrice. Base Your Starting Model And What You Learned From The Previous Questions And Then Try To Improve That Model Until You Find The Best Model You Can. For Each Model You Create, Report Its R2 And Calculate And Report The Corresponding RMSE Score For Both The Train And Test Sets. Carefully Explain Your Criteria For Selecting Your Final (Best) Model. Also You Should Write At Most 15 Lines Of Text, Excluding Plots And Tables. 5. (15 Points) Consider The Following Plots. The First Is Depicting The Relationship Between The Number Of Variables Included In The Model (Ordered By Strength Of Correlation With SalePrice - From Highest To Lowest) And The Predictive Performance (RMSE) Of Your Model In Both The Train And Test Sets. The Second One Focus On The Relationship Between The Number Of Variables And The R-Squared Of The Model In The Train Dataset. What Do You Learn From This Plot? How Does This Inform Your Model Selection Decision? Also You Should Write At Most 15 Lines Of Text, Excluding Plots And Tables. 4 6. (7.5 Points) Now Consider The Variable House Id. Did You Include It In Your Model? Why So Or Why Not? Also You Should Write At Most 10 Lines Of Text, Excluding Plots And Tables. 7. (12.5 Points) Now Consider The Variable Exterior1st. Did You Include It In Your Model? If Not, Create A New Model That Includes Exterior1st. Use This Model To Generate Predictions For The Prediction Set. What Is The Problem That Arises? Explain Why This Problem Occurs And Find A Suitable Solution For It. Additionally, Suggest A Possible Alternative Way In Which The Variable Exterior1st Could Be Included In Your Model (For Instance, Consider Altering The Variable So That This Problem Does Not Prevent The Estimation Of This Model). Also You Should Write At Most 15 Lines Of Text, Excluding Plots And Tables. 8. (20 Points) Use Your Model To Predict Scores In The Prediction Data Set. Submit Your Entry To The Competition And Report Your Team’s Score. Compare The RMSE Reported In The Competion With The RMSEs That You Calculated In (4). Comment On Your Findings. Also You Should Write At Most 15 Lines Of Text, Excluding Plots And Tables. 5 Full Details Of The Dataset MSSubClass: Identifies The Type Of Dwelling Involved In The Sale. 20 1-STORY 1946 & NEWER ALL STYLES 30 1-STORY 1945 & OLDER 40 1-STORY W/FINISHED ATTIC ALL AGES 45 1-1/2 STORY - UNFINISHED ALL AGES 50 1-1/2 STORY FINISHED ALL AGES 60 2-STORY 1946 & NEWER 70 2-STORY 1945 & OLDER 75 2-1/2 STORY ALL AGES 80 SPLIT OR MULTI-LEVEL 85 SPLIT FOYER 90 DUPLEX - ALL STYLES AND AGES 120 1-STORY PUD (Planned Unit Development) - 1946 & NEWER 150 1-1/2 STORY PUD - ALL AGES 160 2-STORY PUD - 1946 & NEWER 180 PUD - MULTILEVEL - INCL SPLIT LEV/FOYER 190 2 FAMILY CONVERSION - ALL STYLES AND AGES MSZoning: Identifies The General Zoning Classification Of The Sale. A Agriculture C Commercial FV Floating Village Residential I Industrial RH Residential High Density RL Residential Low Density RP Residential Low Density Park RM Residential Medium Density LotFrontage: Linear Feet Of Street Connected To Property LotArea: Lot Size In Square Feet Street: Type Of Road Access To Property Grvl Gravel Pave Paved Alley: Type Of Alley Access To Property Grvl Gravel Pave Paved NA No Alley Access LotShape: General Shape Of Property 6 Reg Regular IR1 Slightly Irregular IR2 Moderately Irregular IR3 Irregular LandContour: Flatness Of The Property Lvl Near Flat/Level Bnk Banked - Quick And Significant Rise From Street Grade To Building HLS Hillside - Significant Slope From Side To Side Low Depression Utilities: Type Of Utilities Available AllPub All Public Utilities (E,G,W,& S) NoSewr Electricity, Gas, And Water (Septic Tank) NoSeWa Electricity And Gas Only ELO Electricity Only LotConfig: Lot Configuration Inside Inside Lot Corner Corner Lot CulDSac Cul-De-Sac FR2 Frontage On 2 Sides Of Property FR3 Frontage On 3 Sides Of Property LandSlope: Slope Of Property Gtl Gentle Slope Mod Moderate Slope Sev Severe Slope Neighborhood: Physical Locations Within Ames City Limits Blmngtn Bloomington Heights Blueste Bluestem BrDale Briardale BrkSide Brookside ClearCr Clear Creek CollgCr College Creek Crawfor Crawford Edwards Edwards Gilbert Gilbert IDOTRR Iowa DOT And Rail Road MeadowV Meadow Village Mitchel Mitchell Names North Ames NoRidge Northridge 7 NPkVill Northpark Villa NridgHt Northridge Heights NWAmes Northwest Ames OldTown Old Town SWISU South & West Of Iowa State University Sawyer Sawyer SawyerW Sawyer West Somerst Somerset StoneBr Stone Brook Timber Timberland Veenker Veenker Condition1: Proximity To Various Conditions Artery Adjacent To Arterial Street Feedr Adjacent To Feeder Street Norm Normal RRNn Within 200' Of North-South Railroad RRAn Adjacent To North-South Railroad PosN Near Positive Off-Site Feature--Park, Greenbelt, Etc. PosA Adjacent To Postive Off-Site Feature RRNe Within 200' Of East-West Railroad RRAe Adjacent To East-West Railroad Condition2: Proximity To Various Conditions (If More Than One Is Present) Artery Adjacent To Arterial Street Feedr Adjacent To Feeder Street Norm Normal RRNn Within 200' Of North-South Railroad RRAn Adjacent To North-South Railroad PosN Near Positive Off-Site Feature--Park, Greenbelt, Etc. PosA Adjacent To Postive Off-Site Feature RRNe Within 200' Of East-West Railroad RRAe Adjacent To East-West Railroad BldgType: Type Of Dwelling 1Fam Single-Family Detached 2FmCon Two-Family Conversion; Originally Built As One-Family Dwelling Duplx Duplex TwnhsE Townhouse End Unit TwnhsI Townhouse Inside Unit HouseStyle: Style Of Dwelling 1Story One Story 1.5Fin One And One-Half Story: 2nd Level Finished 1.5Unf One And One-Half Story: 2nd Level Unfinished 2Story Two Story 2.5Fin Two And One-Half Story: 2nd Level Finished 8 2.5Unf Two And One-Half Story: 2nd Level Unfinished SFoyer Split Foyer SLvl Split Level OverallQual: Rates The Overall Material And Finish Of The House 10 Very Excellent 9 Excellent 8 Very Good 7 Good 6 Above Average 5 Average 4 Below Average 3 Fair 2 Poor 1 Very Poor OverallCond: Rates The Overall Condition Of The House 10 Very Excellent 9 Excellent 8 Very Good 7 Good 6 Above Average 5 Average 4 Below Average 3 Fair 2 Poor 1 Very Poor YearBuilt: Original Construction Date YearRemodAdd: Remodel Date (Same As Construction Date If No Remodeling Or Additions) RoofStyle: Type Of Roof Flat Flat Gable Gable Gambrel Gabrel (Barn) Hip Hip Mansard Mansard Shed Shed RoofMatl: Roof Material ClyTile Clay Or Tile CompShg Standard (Composite) Shingle Membran Membrane Metal Metal Roll Roll Tar&Grv Gravel & Tar WdShake Wood Shakes WdShngl Wood Shingles 9 Exterior1st: Exterior Covering On House AsbShng Asbestos Shingles AsphShn Asphalt Shingles BrkComm Brick Common BrkFace Brick Face CBlock Cinder Block CemntBd Cement Board HdBoard Hard Board ImStucc Imitation Stucco MetalSd Metal Siding Other Other Plywood Plywood PreCast PreCast Stone Stone Stucco Stucco VinylSd Vinyl Siding Wd Sdng Wood Siding WdShing Wood Shingles Exterior2nd: Exterior Covering On House (If More Than One Material) AsbShng Asbestos Shingles AsphShn Asphalt Shingles BrkComm Brick Common BrkFace Brick Face CBlock Cinder Block CemntBd Cement Board HdBoard Hard Board ImStucc Imitation Stucco MetalSd Metal Siding Other Other Plywood Plywood PreCast PreCast Stone Stone Stucco Stucco VinylSd Vinyl Siding Wd Sdng Wood Siding WdShing Wood Shingles MasVnrType: Masonry Veneer Type BrkCmn Brick Common BrkFace Brick Face CBlock Cinder Block None None Stone Stone MasVnrArea: Masonry Veneer Area In Square Feet ExterQual: Evaluates The Quality Of The Material On The Exterior 10 Ex Excellent Gd Good TA Average/Typical Fa Fair Po Poor ExterCond: Evaluates The Present Condition Of The Material On The Exterior Ex Excellent Gd Good TA Average/Typical Fa Fair Po Poor Foundation: Type Of Foundation BrkTil Brick & Tile CBlock Cinder Block PConc Poured Contrete Slab Slab Stone Stone Wood Wood BsmtQual: Evaluates The Height Of The Basement Ex Excellent (100+ Inches) Gd Good (90-99 Inches) TA Typical (80-89 Inches) Fa Fair (70-79 Inches) Po Poor (<70 Inches NA No Basement BsmtCond: Evaluates The General Condition Of The Basement Ex Excellent Gd Good TA Typical - Slight Dampness Allowed Fa Fair - Dampness Or Some Cracking Or Settling Po Poor - Severe Cracking, Settling, Or Wetness NA No Basement BsmtExposure: Refers To Walkout Or Garden Level Walls Gd Good Exposure Av Average Exposure (Split Levels Or Foyers Typically Score Average Or Above) Mn Mimimum Exposure No No Exposure NA No Basement 11 BsmtFinType1: Rating Of Basement Finished Area GLQ Good Living Quarters ALQ Average Living Quarters BLQ Below Average Living Quarters Rec Average Rec Room LwQ Low Quality Unf Unfinshed NA No Basement BsmtFinSF1: Type 1 Finished Square Feet BsmtFinType2: Rating Of Basement Finished Area (If Multiple Types) GLQ Good Living Quarters ALQ Average Living Quarters BLQ Below Average Living Quarters Rec Average Rec Room LwQ Low Quality Unf Unfinshed NA No Basement BsmtFinSF2: Type 2 Finished Square Feet BsmtUnfSF: Unfinished Square Feet Of Basement Area TotalBsmtSF: Total Square Feet Of Basement Area Heating: Type Of Heating Floor Floor Furnace GasA Gas Forced Warm Air Furnace GasW Gas Hot Water Or Steam Heat Grav Gravity Furnace OthW Hot Water Or Steam Heat Other Than Gas Wall Wall Furnace HeatingQC: Heating Quality And Condition Ex Excellent Gd Good TA Average/Typical Fa Fair Po Poor CentralAir: Central Air Conditioning N No Y Yes 12 Electrical: Electrical System SBrkr Standard Circuit Breakers & Romex FuseA Fuse Box Over 60 AMP And All Romex Wiring (Average) FuseF 60 AMP Fuse Box And Mostly Romex Wiring (Fair) FuseP 60 AMP Fuse Box And Mostly Knob & Tube Wiring (Poor) Mix Mixed 1stFlrSF: First Floor Square Feet 2ndFlrSF: Second Floor Square Feet LowQualFinSF: Low Quality Finished Square Feet (All Floors) GrLivArea: Above Grade (Ground) Living Area Square Feet BsmtFullBath: Basement Full Bathrooms BsmtHalfBath: Basement Half Bathrooms FullBath: Full Bathrooms Above Grade HalfBath: Half Baths Above Grade Bedroom: Bedrooms Above Grade (Does NOT Include Basement Bedrooms) Kitchen: Kitchens Above Grade KitchenQual: Kitchen Quality Ex Excellent Gd Good TA Typical/Average Fa Fair Po Poor TotRmsAbvGrd: Total Rooms Above Grade (Does Not Include Bathrooms) Functional: Home Functionality (Assume Typical Unless Deductions Are Warranted) Typ Typical Functionality Min1 Minor Deductions 1 Min2 Minor Deductions 2 Mod Moderate Deductions Maj1 Major Deductions 1 Maj2 Major Deductions 2 Sev Severely Damaged Sal Salvage Only Fireplaces: Number Of Fireplaces FireplaceQu: Fireplace Quality 13 Ex Excellent - Exceptional Masonry Fireplace Gd Good - Masonry Fireplace In Main Level TA Average - Prefabricated Fireplace In Main Living Area Or Masonry Fireplace In Basement Fa Fair - Prefabricated Fireplace In Basement Po Poor - Ben Franklin Stove NA No Fireplace GarageType: Garage Location 2Types More Than One Type Of Garage Attchd Attached To Home Basment Basement Garage BuiltIn Built-In (Garage Part Of House - Typically Has Room Above Garage) CarPort Car Port Detchd Detached From Home NA No Garage GarageYrBlt: Year Garage Was Built GarageFinish: Interior Finish Of The Garage Fin Finished RFn Rough Finished Unf Unfinished NA No Garage GarageCars: Size Of Garage In Car Capacity GarageArea: Size Of Garage In Square Feet GarageQual: Garage Quality Ex Excellent Gd Good TA Typical/Average Fa Fair Po Poor NA No Garage GarageCond: Garage Condition Ex Excellent Gd Good TA Typical/Average Fa Fair Po Poor NA No Garage PavedDrive: Paved Driveway 14 Y Paved P Partial Pavement N Dirt/Gravel WoodDeckSF: Wood Deck Area In Square Feet OpenPorchSF: Open Porch Area In Square Feet EnclosedPorch: Enclosed Porch Area In Square Feet 3SsnPorch: Three Season Porch Area In Square Feet ScreenPorch: Screen Porch Area In Square Feet PoolArea: Pool Area In Square Feet PoolQC: Pool Quality Ex Excellent Gd Good TA Average/Typical Fa Fair NA No Pool Fence: Fence Quality GdPrv Good Privacy MnPrv Minimum Privacy GdWo Good Wood MnWw Minimum Wood/Wire NA No Fence MiscFeature: Miscellaneous Feature Not Covered In Other Categories Elev Elevator Gar2 2nd Garage (If Not Described In Garage Section) Othr Other Shed Shed (Over 100 SF) TenC Tennis Court NA None MiscVal: $Value Of Miscellaneous Feature MoSold: Month Sold (MM) YrSold: Year Sold (YYYY) SaleType: Type Of Sale WD Warranty Deed - Conventional CWD Warranty Deed - Cash VWD Warranty Deed - VA Loan New Home Just Constructed And Sold COD Court Officer Deed/Estate 15 Con Contract 15% Down Payment Regular Terms ConLw Contract Low Down Payment And Low Interest ConLI Contract Low Interest ConLD Contract Low Down Oth Other SaleCondition: Condition Of Sale Normal Normal Sale Abnorml Abnormal Sale - Trade, Foreclosure, Short Sale AdjLand Adjoining Land Purchase Alloca Allocation - Two Linked Properties With Separate Deeds, Typically Condo With A Garage Unit Family Sale Between Family Members Partial Home Was Not Completed When Last Assessed (Associated With New Homes) 16