FPP data problems

From TestimonyofThomas
Jump to navigation Jump to search

2007-03-23 21:34:25

Data problems

CSV inventory

Assessment Month Number of CSVs extant
Mbatwe-2005-10 186
Mbatwe-2006-06 235
Mbatwe-2006-11


Mbatwe 2005-10-00

  • sicknessDurationMonths seems to have some really bad data (very large numbers)
  • family:waterDistanceMeters has some really large numbers incl. 50,000
  • Answer code 2 needs an answer in sicknessType, or maybe 2 is a bad entry.
  • family:interviewer needs to have spellings standardized so each interviewer appears only once
  • family:interviewed should have been entered with a member number, it seems
  • Mbatwe-F-4-2005-10 family has room type '2'
  • Family D15 was exported from the wrong page of the spreadsheet. May need to enter again.

Mbatwe 2006-06-00

  • Answer meanings have changed= Must reconcile.=
  • A-1 Duplicate not back to back. Kato can fix and rerun.
  • A-12 Sickness symptom problem. Tom has to comment.
  • A-17 It appears that a "\\" in the data confused either the buildinserts program or mysql. Tom needs to be aware of this. Kato can fix and rerun.
  • A-2 Sickness symptom problem. Tom has to comment.
  • A-28 Sickness symptom problem. Tom has to comment.
  • D-28 Sickness symptom problem. Tom has to comment.
  • E-1 Duplicate family. Tom has to comment.
  • J-1 Duplicate family. Tom has to comment.
  • J-2 Duplicate family. Tom has to comment.
  • All data that should have gone into person:isEmployed went into person:whereEmployed
  • person:occupation is showing all numbers. Need to add answer codes to database.
  • There is a family:latrineType, family:bathHouseType, family:doortype 17. We must not have building type answer codes 17-19+. Also need better translations on the building materials. Here's the change:
    • 2005-10-00
    • 8,"Barrel foil","Chapas de tambor",
    • 9,"Cement","Cimento",
    • 10,"Fabricated wood","Contaplacado",
    • 11,"Corrugated asbestos-cement sheeting","Lusalite",
    • 12,"Wood","Madeira",
    • 13,"Mud","Matope",
    • 14,"Cardboard","Papelão",
    • 15,"Plastic lined","Plástico",
    • 16,"Sack","Saco",
    • 17,"Corrugated galvanized steel","Zinco",
    • 18,"","Pedras",
    • 2006-06-00
    • 8,"Cement","Cimento",
    • 9,"Fabricated wood","Contaplacado",
    • 10,"Corrugated asbestos-cement sheeting","Lusalite",
    • 11,"Wood","Madeira",
    • 12,"Mud","Matope",
    • 13,"Cardboard","Papelão",
    • 14,"Plastic lined","Plástico",
    • 15,"Sack","Saco",
    • 16,"Corrugated galvanized steel","Zinco",
  • Mbatwe-J-19 family has `homeOccupancy` = '6'
  • Three different families have lightingType '9'
  • Mbatwe-I-1 has hasPestProblems = '13'
  • Portuguese doesn't show up as a language, and there is a rare 19 and 21. These are totally changed. Need to talk to Moises.
    • 2005-10-00
    • 4,"Portuguese","Português"
    • 5,"Sena","Sena"
    • 6,"Ndau","Ndau"
    • 7,"Changana","Changana"
    • 8,"Matswa","Matswa"
    • 9,"Shona","Shona"
    • 10,"Macua","Macua"
    • 11,"Chitswa","Chitswa"
    • 12,"Chuabo","Chuabo"
    • 13,"English","Inglês"
    • 14,"Chichewa","Chichewa"
    • 15,"Lomwé","Lomwé"
    • 16,"Maconde","Maconde"
    • 17,"Chobe","Chobe"
    • 18,"Bitonga","Bitonga"
    • 19,"Núngue","Núngue"
    • 2006-06-00
    • 4,"Bitonga","Bitonga"
    • 5,"Changana","Changana"
    • 6,"Chichewa","Chichewa"
    • 7,"Chitswa","Chitswa"
    • 8,"Chobe","Chobe"
    • 9,"Chuabo","Chuabo"
    • 10,"Inglês","Inglês"
    • 11,"Lomwé","Lomwé"
    • 12,"Maconde","Maconde"
    • 13,"Macua","Macua"
    • 14,"Matswa","Matswa"
    • 15,"Ndau","Ndau"
    • 16,"Portuguese","Portuguese"
    • 17,"Sena","Sena"
    • 18,"Shona","Shona"
  • Add a zero to the 1 digit familyId's so they will sort right.

I reviewed pretty carefully down to family:lightingType

I started at family:lightingType and went thru the rest of the indicators

The graph doesn't load for 2006, but does for 2005

  • family:hasLatrineSink doesn't show up on 2006
  • family:hasStanding water doesn't show up on 2006
  • family:isAnyMemberEmployed
  • family:hasAnyMemberProfessionalSkill
  • family:hasTruantChild
  • family:hasAnyMemberProfessionalCourse
  • person:isEmployed
  • person:hasProfessionalSkills
  • family:isWaterTreated
  • family:babyFood
  • family:farmFieldDistanceMeters
  • family:hasFamilyConflict
  • family:hasAnyMemberMentalProblems
  • person:hasMentalProblems
  • family:isAnyMemberSick
  • family:hasAnyMemberSicknessTreatment
  • family:mostCommonDisease
  • family:lastSicknessDate
  • family:hasMemberWithCOnstantDiahrrea
  • family:hasMemberWithConstantHeadache, skinsores, coughing, coughing blood
  • family:hasEnoughMosquitoNets
  • person:isHealthy
  • person:sicknessType
  • person:sicknessDurationMonths
  • person:sicknessTreatmentType
  • person:sicknessTreatmentDurationMonths
  • family:isAnyMemberCommunityLeader
  • person:isCommunityLeader
  • person:hasIdCard
  • person:isTruantChild
  • person:hasProfessionalCourse
  • person:professionalCourse


  • family:businessPastWhyStopped has a 9 and a 10 column
  • person:occupation the numbers didn't connect with the occupation names
  • I think the whereEmployed graph and the isEmployed graph got switched up.
  • person:professionalSkill has a 2 column
  • family:dailyMeals the e in tres is wierd. Should be três
  • diet:food the English translation of mariscos (I think) is seafood. Does that cover eggs and meat as well?
  • I think all the tres have a weird e. family:babyDailyMeals
  • farmFieldProduct has a 9 column
  • farmFieldProductUse should the Portuguese read "Qual é o destino dessa produção?" ??? I think it's missing the é
  • family:farmCommuteMeans it should be A pé instead of R pé
  • homeGardenProduct has a 16 and a 17
  • animalRaised has a 15, also should the Portuguese read "Qual é o destino dessa criação" ???
  • family:hasSmoker should the question say fuma instead of fume??? I'll check on this
  • person:isVaccinationCurrent has a 4
  • language has 19 and 21





Web site problems

  • Need to use actual question text in drop-down menu.
  • Need to use question text from appropriate year's assessment.
  • When there is no such question for the given year, need to show some kind of an "empty" graph message.