08/03/2018 : 2020 Census Quarterly Program Management Review (PMR)


>>GOOD AFTERNOON.
WE DON’T WANT TO KEEP YOU HERE TO LATE ON A FRIDAY AFTERNOON
BUT WE HAVE A LOT OF INFORMATION.
IF YOU COULD FIND YOUR SEATS.
GOOD AFTERNOON AND I’D LIKE TO WELCOME ALL OF YOU WHO ARE HERE
IN OUR AUDITORIUM AT CENSUS
HEADQUARTERS AND THOSE JOINING US ONLINE TO THE 2020 CENSUS
PROGRAM MANAGEMENT REVIEW. I’M AL FONTENOT THE DIRECTOR OF
AND WE LOOK FORWARD TO SHARING THE PROGRESS OF OUR PROGRAM OVER
THE NEXT FEW HOURS BUT FIRST A FEW HOUSEKEEPING MATTERS.
IT’S WEBCAST LIVE TO CONSIDER ALL MICS LIVE AT ALL TIMES.
AT THE END OF EACH PRESENTATION WE’LL HAVE A QUESTION AND ANSWER
PERIOD. WHEN ASKING A QUESTION PLEASE
SHARE YOUR NAME, AFFILIATION AND SPEAK DIRECTLY INTO THE MIC SO
OUR FRIENDS ONLINE WILL BE ABLE TO HEAR YOU AS WELL.
KYLE WILCOX FROM TELECOMMUNICATIONS WILL ADDRESS
YOUR USE MUCH THE iPAD AND GUEST WIRELESS ACCESS.
KYLE.>>THANK YOU.
GOOD AFTERNOON, EVERYONE. I’LL GIVE YOU A BRIEF DEMO ON
HOW TO USE YOUR iPAD AND CONNECTING TO THE GUEST WI-FI.
IF YOU CAN BRING YOUR iPADS TO THE HOME SCREEN LOCATING THE
HOME BUTTON ON THE RIGHT SIDE OF THE PAD IN THE MIDDLE.
THE FIRST APPLICATION ON THE BOTTOM IS MOSS 360 AND THIS IS
USED TO VIEW THE AGENDA AND PRESENTATION FOR TODAY’S PMR.
THE DOCUMENTS WILL BE ON THE LEFT SIDE OF THE SCREEN.
WHEN YOU SELECT A PRESENTATION IT WILL APPEAR ON THE RIGHT.
IF YOU WANT TO EXPAND THE VIEW, THERE’S AN “X” IN THE TOP MIDDLE
AND IF YOU EXPAND THAT IT WILL EXPAND THE VIEW AND IF YOU GO
BACK TO THE PRESENTATIONS YOU’LL HIT DOCS IN THE TOP LEFT HAND
CORNER. GOU BACK TO THE HOME SCREEN, THE
NEXT APPLICATION IS SAFARI AND THIS WILL ALLOW YOU TO BROWSE
THE WEB FOR ANYTHING YOU MAY NEED.
IN FRONT OF YOU, YOU HAVE 10 CARDS DISPLAYING THE GUEST
WIRELESS CREDENTIAL. TO CONNECT YOUR PERSONAL DEVICE
GO TO YOUR WI-FI SETTINGS AND CONNECT TO THE SYSTEM 10 ACCOUNT
AND ONCE YOU’RE CONNECTED YOU’LL GO TO YOUR PREFERRED WEB BROWSER
AND ACCESS ANY WEBSITE AND WHEN THEY DO THAT IT WILL PROMPT YOU
FOR THE CREDENTIALS ON THE CARD. ONCE ENTER THE CREDENTIALS AND
IT ACCEPTS IT YOU’LL HAVE WIRELESS ACCESS.
IF YOU HAVE ANY QUESTIONS MYSELF AND OTHER COLLEAGUES WILL BE
HERE TO ASSIST. THANK YOU.
>>THANK YOU, KYLE. IF YOU’RE JOINING US ONLINE AND
HAVE YOU A QUESTION, SEND AN E-MAIL TO [email protected]
[email protected] .gov.
MOLLY SHEY OUR ASSISTANT CHIEF OF ACQUISITIONS WILL REMIND
STAFF OF LEGAL OBLIGATIONS WHEN SPEAKINGSPEAKING WITH
CONTRACTORS.>>I’M WITH CENSUS ACQUISITIONS.
TODAY THERE’S A LOT OF CONTRACTOR, GOVERNMENT AND
PROGRAM REPRESENTATIVES IN THIS ROOM.
I WANTED TO TAKE THIS OPPORTUNITY TO REMIND EVERYONE
THAT EVERYTHING THAT IS SAID TODAY IS PUBLICLY AVAILABLE
INFORMATION. HOWEVER, PLEASE EXERCISE DUE
DILIGENCE DURING BREAKS AND WHEN HAVING DISCUSSIONS OUTSIDE OF
THE BRIEFING TO ONLY DISCUSS WHAT IS PUBLICLY AVAILABLE.
FOR EXAMPLE, IF YOU ARE A CONTRACTOR, PLEASE DO NOT
COMMENT ABOUT ANOTHER CONTRACTOR’S PERFORMANCE TO
ANOTHER CONTRACTOR. THINGS LIKE THAT.
OR IF YOU ARE A GOVERNMENT REPRESENTATIVE, DO NOT SHARE
PROCUREMENT SENSITIVE INFORMATION OR COMMENT ON A
CONTRACTOR’S PERFORMANCE. ANYTHING THAT IS PUBLICLY
AVAILABLE INCLUDING ANYTHING THAT IS TALKED ABOUT IN THE
BRIEFINGS TODAY, AGAIN, ANYTHING ALREADY OUT IN THE PUBLIC YOU
MAY TALK ABOUT. BUT ANYTHING THAT IS SENSITIVE
INCLUDING TO PERFORMANCE UNDER A CONTRACTOR ONGOING PLEASE DO NOT
DISCUSS. THANK YOU VERY MUCH.
>>THANK YOU, MOL FLIP —
MOLLY. IF YOU ARE HERE FROM THE MEDIA
WE WELCOME YOU AND ASK TO YOU SIGN IN.
THERE’S AN AREA TO SIT WITH THE STAFF FROM THE PUBLIC
INFORMATION OFFICE. THEY’RE HERE TO HELP YOU IF YOU
HAVE QUESTION OR WOULD LIKE TO INTERVIEW LEADERSHIP AND STAFF.
MICHAEL COOKE, CHIEF OF OUR PUBLIC INFORMATION OFFICE IS
WITH US THIS AFTERNOON. MICHAEL, WAVE TO US.
MAY I ASK YOU AND YOUR STAFF ALSO TO STAND SO YOU CAN BE
EASILY IDENTIFIED. IF YOUR STAFF WOULD STAND,
PLEASE. THANK YOU VERY MUCH.
A LAST FEW REMINDERS, THE LOCATION OF THE RESTROOMS IS
OUTSIDE THE ELEVATOR, DOWN THE HALLWAY AND OUTSIDE THE
AUDITORIUM AND DOWN THE HALL WAY AND NEXT TO THE GREEN ELEVATORS
AND IN CASE OF AN EMERGENCY PLEASE LISTEN TO THE P.A. SYSTEM
AND IF REQUIRED WE WILL EXIT USING THE EMERGENCY EXITS YOU
SEE AROUND THE ROOM.
AS WE SAID AT EVERY P.M.R., THE SUCCESS OF THE CENSUS BUREAU AND
2020 CENSUS REALLY RESTS ON THE COLLECTIVE TALENT OF THE TEAM
WORKING ON THE PROGRAM BOTH WITHIN THE DECENNIAL DIRECTORATE
AND ACROSS THE CENSUS BUREAU. BEFORE I DIVE IN TO THE AGENDA I
WOULD LIKE TO TAKE A MOMENT TO SAY THANK YOU TO THOSE FROM THE
DECENNIAL LEADERSHIP TEAM GROWING IN THEIR CAREERS IN THE
CENSUS BUREAU BUT NO LONGER AS PART OF THE DECENNIAL DIRECTORATE.
TASHA BOONE. FORMER CHIEF OF THE DECENNIAL
CENSUS MANAGEMENT DIVISION NOW SENIOR ADVISER TO THE OFFICE OF
THE DIRECTOR. SHE BRINGS HER EXPERIENCE AND
COMMUNICATION PROGRAM AND PARTNERSHIPS PROGRAM AND
DECENNIAL PROGRAM ALL TOGETHER TO BE ABLE TO BE AN EXCELLENT
ASSET TO THE ORGANIZATION TO HELP US MOVE INTO 2020 WITH
COORDINATED EFFORTS BETWEEN DECENNIAL PLANNING, FIELD AND
OUR COMMUNICATION DIRECTORATE. THANK YOU, TASHA.
[APPLAUSE]>>KIMBERLY HIGENBOTHAM ALSO WITH D.C.M.D.
AND IN DOCUMENT SERVICES IN THE ADMINISTRATIVE SERVICES AND WE
HAVE A NEW DIVISION CHIEF FOR THE DEMOGRAPHIC STATISTICAL
MESSAGE DIVISION, ANTHONY IS NOT IN THE ROOM.
THANK YOU, TASHAA, KIM AND ANTHONY FOR YOUR SERVICE WITHIN
THE DECENNIAL DIRECTORATE. WE WILL MISS YOU.
YOU WILL BE A VALUE TO THE BUREAU AND TO THE DECENNIAL
PROGRAM WORKING IN YOUR NEW ROLES.
WE ALSO HAVE RECENT PROMOTIONS WITHIN DECENNIAL.
JEREMY WEDAMIN IS NOW A PROGRAM MANAGER FOR THE INTEGRATION OF
OPERATIONS AND SYSTEMS IN THE DECENNIAL CENSUS MANAGEMENT
DIVISION. JEREMY, ARE YOU HERE TODAY?
THANK YOU. BRIAN DEVOS IS NOW IN SYSTEMS IN
D.C.M.D. BRIAN IS NOT HERE TODAY.
AND JENNIFER LEM STARTED AS AN I.T. SPECIALIST WITH THE
TECHNICAL INTEGRATOR STAFF. CONGRATULATIONS FOR YOUR NEW
ROLES WITHIN THE DIRECTORATE. JOINING THE DECENNIAL
DIRECTORATE ARE SUSAN PATINO ON LEAVE SELECTED AS THE NEW DEPUTY
CHIEF WORK WITH STEF STEMPOWSKI. THE WORKED IN THE FIELD AND
DEMOGRAPHIC DIRECTORATE TO PROVIDE TOOLS FOR DATA
COLLECTION AND DATA PERFORMANCE MONITORING AND MANAGEMENT.
AND LASTLY, JOAN HILL IS RETURNING TO THE DECENNIAL
STATISTICAL STUDIES DIVISION AS THE ASSISTANT DIVISION CHIEF FOR
EXPERIMENTS AND EVALUATIONS. RECENTLY JOAN SERVED AS AT THE
SURVEY ANALYTICS IN THE OFFICE OF SURVEY AND CENSUS ANALYTICS
AND WILL SALT LAKE CITY — ALSO A FORMER
MEMBER OF THE DECENNIAL TEAM COMING BACK.
WE WANT TO WELCOME THEM TO THE TEAM AT THIS TIME.
WE HAVE A LOT OF INFORMATION TO SHARE TODAY.
AND I’LL TOUCH ON SOME OF OUR HOT ISSUES.
AS YOU LOOK AT THE AGENDA YOU’LL SEE WE CONTINUE TO FOCUS ON THE
KEY ELEMENTS TO BE ABLE TO CONDUCT A FULL AND ACCURATE
CENSUS IN 2020. WE WILL OPEN THE P.M.R. AGENDA
WITH A DISCUSSION ON ONE OF THE CORE VALUES AND GUIDING
PRINCIPLES FROM THE CENSUS BUREAU.
YOU CAN TRUST YOUR INFORMATION IS SAFE.
THIS HAS BEEN A FUNDAMENTAL PART OF THE CENSUS DNA AND DICTATED
BY LAW IN TITLE 14 AND FORCED BY DECADE OF CULTURAL PRACTICES,
TRAINING AND BEHAVIOR. KEVIN SMITH IS GOING TO DISCUSS
THIS PRINCIPLE IN THE CONTEXT OF THE CURRENT CYBER ENVIRONMENT
AND THE PRACTICES AND PROCESSES WE HAVE ADOPTED TO ENSURE THE
DATA THE PUBLIC SHARES WITH US IS SECURE.
AND THAT WE MAINTAIN THE PUBLIC TRUST BECAUSE YOUR INFORMATION
IS SAFE WITH THE CENSUS BUREAU. KEVIN IS OUR CIO AND ASSOCIATE
DIRECTOR FOR OUR I.T. DIRECTORATE.
SECOND, AS WE APPROACH THE CLOSING DAYS OF THE 2018
END-TO-END CENSUS TEST I’M REMINDED OF A STATEMENT MADE AT
A PREVIOUS PROGRAM MANAGEMENT REVIEW BY ASSISTANT PROGRAM
MANAGEMENT CHIEF MARYANN AND SHE’S A 32-YEAR VETERAN OF THE
CENSUS BUREAU AND WAS A KEY PLAYER IN THE 2010 CENSUS AHAS
BEEN A KEY PARTICIPANT IN THE RESEARCH, PLANNING AND
DEVELOPMENT OF THE DESIGN OF THE 2020 CENSUS.
MARYANN, STAND UP SO YOU CAN BE RECOGNIZED, PLEASE.
AND MARYANN SAID I’D LIKE TO REMIND EVERYONE WHY WE CONDUCT
CENSUS TEST. THE CONDUCT IS A MAJOR
UNDERTAKING WITH MANY MOVING PARTS.
AS WE PLAN THE OPERATIONAL DESIGN OF THE 2020 CENSUS ALONG
WITH THE TRIED AND TRUE PROCEDURES WE ARE DEVELOPING NEW
METHODS, NEW PREJ — PROCEDURES AND SOLUTIONS TO LEVERAGE NEW
TECHNOLOGY AND CONSIDERING METHOD LOGICAL INNOVATIONS AND
AWARE OF THE CHANGING WORLD AROUND US FROM A SOCIAL AND
ECONOMIC PERSPECTIVE. THOUGH WE WANT OUR CENSUS TEST
TO RUN SMOOTHLY WE EXPECT TO LEARN FROM THE TEST AND DISCOVER
WHAT ASPECTS OF POTENTIAL SOLUTIONS WORK WELL ALONG WITH
THINGS THAT DON’T WORK WELL AND UNCOVER THINGS EXPECT AND
UNEXPECTED AND EXPLORE ASPECTS OF AN OPERATIONAL DESIGN THAT
MAY REQUIRE REFINEMENT OR MAY NOT MAKE THE FINAL CUT.
WE’LL EXPECT TO TAKE ADVANTAGE OF BEING IN A TEST ENVIRONMENT
AND ADD NEW DIMENSION TO A TEST AS OPPORTUNITIES ARISE.
WE LEARN AS MUCH IF NOT MORE FROM THE UNEXPECTED PROMPTS
ALONG THE WAY THAN FROM THE THINGS THAT RUN SMOOTHLY AND
EARLIER IN THE TEST WE HAVE SUCCESSFULLY DEPLOYED OUR
SYSTEMS IN VARIOUS GEOGRAPHIC AND TOPOGRAPHICAL CONDITIONS
DEMONSTRATING THE CAPABILITY TO WORK ONLINE AND ONLINE WHAT WE
CALL THE DISCONNECTED STATE. WE SAW INCREASES UPON THE PLAN
AND IN THE ADDRESSES IN THE FIELD LISTING OPERATION AND WERE
ABLE TO VALIDATE THE EFFECTIVENESS OF OUR IN-OFFICE
CANVASSING OPERATIONS WHICH WILL ENABLE US TO CANVAS 100% OF THE
ADDRESSES IN THE NATION WHILE ONLY NEEDING TO DO APPROXIMATELY
30% OF THE ADDRESS BUSINESS DEPLOYING LISTERS ON THE STREET.
IN MARCH, WE TESTED THE MOST IMPORTANT INNOVATION OF THE 2020
CENSUS PLAN. THE ABILITY TO ALLOW RESPONDENTS
TO RESPOND ELECTRONICALLY ON THE INTERNET.
OVER 60% OF OUR RESPONSE TO THE CENSUS WILL COME FROM
SELF-RESPONSE. IN 2010, THE ONLY WAY TO RESPOND
WAS BY FILLING OUT AND MAILING A PAPER QUESTIONNAIRE.
IN 2020, WE ARE EXPECTING THE LARGEST PERCENTAGE OF OUR
SELF-RESPONSE TO COME THROUGH THE INTERNET.
THE TEST IN PROVINCE SHOWED 60% CAME THROUGH THE INTERNET WHICH
MET OUR EXPECTATION. MOST IMPORTANTLY TO US, PEOPLE
WERE ABLE TO SUCCESSFULLY NAVIGATE AND USE OUR INTERNET
SELF-RESPONSE APPLICATION. PRIOR TO THE PUBLIC RELEASE OF
THE PUBLICATION WE ENCOUNTERED SMALL DESIGN AND FUNCTIONAL BUGS
QUICKLY ADDRESSED WITHOUT IMPACTING THE ABILITY OF PEOPLE
TO RESPOND TO THE CENSUS. THAT WAS ANOTHER LEARNING.
HAVING A TEAM STANDING BY AND READY WHO COULD RESPOND QUICKLY
TO ANY CHALLENGE US MAY INCUR. WE HAD A TEAM AND MICHAEL WORKED
CLOSELY LEADING THE TEAM AND THANK YOU FOR THE WORK YOU DID
TO ADDRESS ISSUES THAT MAKE SURE THAT DID NOT IMPACT OUR ABILITY
TO COLLECT DATA FROM OUR RESPONDENTS.
WE SUCCESSFULLY WERE ABLE TO ESTABLISH A CENSUS QUESTIONNAIRE
CENSUS ABILITY TO ASSIST ANSWERING QUESTIONS AND
ASSISTING PEOPLE WHO NEEDED HELP RESPONDING AND WANTED TO
COMPLETE THEIR CENSUS OVER THE PHONE.
7.5% OF THE SELF-RESPONDERS CHOSE TO COMPLETE THE CENSUS
INTERVIEW OVER THE PHONE AND 31% MAILED BACK A CENSUS
QUESTIONNAIRE. WE WERE EFFECTIVELY ABLE TO
MANAGE AND INJEST ALL THREE MODES OF RESPONSE WITH ALL
SYSTEMS PERFORMING AS PLANNED. AS WE WIND DOWN THE NON-RESPONSE
FOLLOW-UP PHASE OF OUR TEST, OUR EARLY ASSESSMENT TELLS US WE’RE
ABLE TO CELEBRATE A NUMBER OF SUCCESSES AND APPLY A NUMBER OF
THINGS WE LEARNED ALONG THE TEST.
PRIMARY OBJECTIVE WAS TO PROVE OUT THE NEW TECHNOLOGY AND TEST
AND VALIDATE THE 2020 CENSUS OPERATIONS, PROCEDURES, SYSTEMS
AND FIELD INFRASTRUCTURE TO ENSURE PROPER INTEGRATION AND A DOCUMENT
POSTED ON OUR WEBSITE THAT INDICATES OUR OBJECTIVES OF THE
TEST. EARLIER TESTS GAVE US EVIDENCE
OF IMPROVED EFFICIENCY. THIS TEST CONTINUED THAT TREND.
WE CLEARLY OBSERVED GREATER PRODUCTIVITY AND PRELIMINARY
RESULTS SHOWED PRODUCTIVITY IN THE 2018 TEST WAS APPROXIMATELY
1.56 CASES PER HOUR. THE FINAL RACE IN THE 2010
CENSUS WAS 1.05 CASES PER HOUR. WE NOTED A SUBSTANTIAL INCREASE
IN PRODUCTIVITY. MOST OF THAT WE CAN ATTRIBUTE TO
THE AUTOMATION AND DIRECTING BETTER ROUTINGS AND PLANNING
INTO INTO THE CENSUS ENUMERATORS DAILY ACTIVITY.
THE OPTIMIZER WAS A CONSIDERABLE ADVANTAGE OVER HAVING PEOPLE
GUESS THE BEST ROUTE THEMSELVES. THE SECOND THING IS WE ELIMINATED THE ABILITY TO PICK
UP THE PAPER ASSIGNMENTS FROM THE CREW LEADER ONCE A DAY AND
TURN IN THE WORK YOU HAVE ACCOMPLISH AND ELIMINATE THE
REQUIREMENT TO COME AND BRING YOUR PAPER PAYROLL AND TURN THAT
INTO YOUR CREW LEADER ONCE A DAY WHICH WERE ALL REQUIREMENTS OF
2010. WHAT WE DID WAS ELECTRONICALLY
DOWNLOADED THEIR ASSIGNMENTS EVERY NIGHT TO THEIR iPHONE 7
AND WE UPLOADED THE WORK AS IT WAS ACCOMPLISHED.
SO NO WORK RESTED ON THE DEVICE. AS THEY FINISHED THROUGH
ENUMERATION IT WAS UPLOADED TO OUR INTERNAL SYSTEMS AT THE
CENSUS AND NEW WORK WAS GIVEN TO THEM EACH NIGHT.
PAYROLL WAS SUBMITTED EVERY NIGHT ON THE iPHONE 7.
WE AUTOMATE HAD PROCESS AND ONE THING NOT MENTIONED HERE WAS WE
ELIMINATE THE REQUIREMENT OF CLERKS TO KEY IN THE PAYROLL
EVERY DAY WHICH WAS A HUGE OPERATION IN 2010 WHICH REQUIRED
OFFICES TO BE OPEN 24/7 JUST TO MANAGE THE PAYROLL.
THAT WON’T BE REQUIRED BECAUSE WE’VE ELIMINATED THE REQUIREMENT
FOR MANUAL PAYROLL FOR 99% OF THE PEOPLE.
AS WE NOTED BEFORE IN PRIOR P.M.R.s WE WERE UNABLE TO HIRE
THE ENUMERATORS IN PROVINCE WHICH HAD A 4% UNEMPLOYMENT
LEVEL WHICH MATCHES THE NATION AND RISES A CONCERN IN OUR MIND
IN TERMS OF HOW WE MANAGE IN A LOW UNEMPLOYMENT ENVIRONMENT TO
STILL GET ADEQUATELY STAFFED. WE DEPLOYED TO THE FIELD
APPROXIMATELY 67% OF THE PLANNED STAFFING LEVELS FOR NON-RESPONSE
FOLLOW-UP OPERATION. WE HAD A PLANNED NEED OF 1,049
ENUMERATORS AND DEPLOYED 735 TO THE FIELD.
THIS CLEARLY UNDERSCORED AN IMPORTANT NEED IN 2020.
THAT’S A STRONG RECRUITING CAMPAIGN AS A PART OF OUR MEDIA
EFFORTS AND THE FULL ENGAGEMENT OF OUR PARTNERSHIP STAFF AND
PARTNERS AND COMMUNITY TO HELP RECRUIT MORE FIELD WORKERS.
AS AN ACTION ALREADY TAKEN IN PLANNING, PARTIALLY INFLUENCED
BY OUR NEED FOR ENGAGEMENT DURING THE RECRUITING PHASE AND
FOR OVERALL ENGAGEMENT, WE INCREASED OUR PARTNERSHIP STAFF
FROM 1,000 TO 1500 PARTNERSHIP SPECIALIST.
WE HAVE DONE THAT WITHOUT INCREASING THE COST OF THE
PARTNERSHIP SPECIALIST BUSINESS LOOKING AT THE OPTIMAL TIME TO
BRING THEM ON BOARD AND OPTIMAL TIME TO RELEASE THEM.
BY CLOSING IN THOSE ENDS WE’RE ABLE TO BRING IN 1500 AT THE
SAME COST OF 1,000 AT A TIME WHEN THEY WERE LESS EFFECTIVE ON
THE TAIL OF THE OPERATION.
WITH FEWER ENUMERATORS IN THE TEST WE FOCUSSED EARLY IN THE
TEST ON A SERIES OF AREAS INCLUDING BUT NOT EXCLUSIVELY
LIMITED TO THE EFFECTIVENESS OF MIXTURE OF ONLINE AND CLASSROOM
TRAINING TO PREPARE FIELD WORKERS TO DEAL WITH THE
CHALLENGES OF ENGAGING RESPOND ENTS AND USING THE DEVICE.
SECOND, WE LOOKED THE OPT MIDER EEFFECTIVELY MANAGED THROUGH
ROUTED FIELD STAFF. THIRDLY, WE LOOKED AT TESTING
AND PROVING THE EFFECTIVENESS OF THE PERSONNEL SYSTEMS.
FOURTH, WE LOOKED AT TESTING THE CAPABILITIES AND FUNCTIONALITY
OF THE HANDHELD ENUMERATION DEVICE BOTH CONNECTED TO THE
INTERNET AND IN A DISCONNECTED MODE AND SECURED THE
TRANSMISSION OF ALL DATA FROM THE ENUMERATOR DEVICES TO
OPERATIONAL CONTROL SYSTEMS AND INTO THE DATA LEG AND THE BACK
END PROCESSING SYSTEMS WHICH WE CALL THE DECENNIAL RESPONSE
RECEIVING ACTIVITIES. THIS FOCUS IN ADDITION TO HIGHER
PRODUCTIVITY GAVE THE OPERATION A STRONG START AND HELPED US
THOROUGHLY WORK OUT THE SYSTEMS INTEGRATION FROM SYSTEM TO
SYSTEM AND HUMAN TO SYSTEM. AS WE ENTERED THE FINAL WEEKS OF
NORFU WE EXPECTED STAFF ATTRITION AND RECEIVED THE
ATTRITION WE HAD EXPECTED. IT GAVE US FEWER STAFF THAN WE
HAD HOPED TO HAVE AT THAT STAGE OF THE OPERATION AND WANT TO
DETERMINE THE MOST EFFECTIVE USE OF THAT STAFF TO MAXIMIZE OUR
LEARNING AND ENSURE ALL OPERATIONAL AREAS WERE BEING
TESTED APPROPRIATELY. WE CHOSE TO DEVOTE THEM TO TASK
ASSIST US IN EVALUATING WAYS TO ENSURE QUALITY DATA USING OUR
TECHNOLOGY. THIS WAS A PRODUCTIVE DECISION.
WE GAINED TREMENDOUS INSIGHT AND OBSERVED POSITIVE RESULTS WHICH
WE WILL INCORPORATE IN OUR PLANS MOVING FORWARD.
AS A FEW EXAMPLES WE CONTACTED NON RESPONDING ADDRESSES WITH
MISSING INFORMATION AND SELECTED AREAS THAT REFLECTED A DIVERSE
MIX OF NEIGHBORHOOD AND LIVING ARRANGEMENTS AND WERE ABLE TO
COLLECT MORE USABLE INFORMATION FROM A SUBSTANTIAL AMOUNT OF
THESE ADDRESSES WITH THE BLITZ TECHNIQUE.
THIS ASSISTED US IN THE EARLY IMPLEMENTATION OF A RECONTACT
STRATEGY WHEN WE ROLL INTO 2020. WHEN DO WE WANT TO HAVE A
RECONTACT STRATEGY? SIMILARLY WE MADE CHANGES IN THE
WAY WORK WAS ASSIGNED AND EXTENDED THE NUMBER OF CONTACT
ATTEMPTS AND NEIGHBORHOODS WITH LOWER SPOTS AND WE WERE
EFFECTIVE IN SUCCESSFULLY COLLECTING DATA AND
WE WILL CHANGE THE RULES TO ENABLE THIS CAPABILITY.
WE ASSESS THE SIZE OF THE GEOGRAPHIC UNITS TO DETERMINE
THE ASSIGNMENT INS —
ASSIGNMENTS IN LATE-TIME ASSIGNMENT AND WE CAN MAINTAIN
THE ADVANTAGES OF AN AUTOMATED OPERATION WHILE AT THE SAME TIME
ENABLING EASILY IMPLEMENTED CUSTOMIZATION TO MEET SPECIFIC
ON-THE-GROUND SITUATION AND WILL CONTINUE TO ENSURE WE DELIVER A
THOROUGH, HIGH-QUALITY CENSUS COUNT IN 2020.
THE TEAM WILL PROVIDE THE DETAILED UPDATE ON THE 2018
COUNCIL. AUDREY CALORI OF THE TECHNOLOGY
DIVISION WILL PROVIDE AN UPDATE ON SYSTEMS READINESS AND THE
STATUS ON SYSTEMS THAT HAVE BEEN TESTED, THE REMAINING SYSTEMS TO
BE TESTED AND A LOOK AT THE PERFORMANCE AND SCALEABILITY
TEST PLAN BETWEEN NOW AND CENSUS DAY.
FINALLY, JIM TRIPE WILL HAVE A PRESENTATION ON THE 2020 MASTER
SCHEDULE AS WELL AS A PRESENTATION ON 2020 CENSUS RISK
MANAGEMENT. NOW, ON TO OUR TIME LINE SLIDE.
IT SHOWS HOW CLOSE WE ARE TO COUNCIL DAY.
WE’RE 606 DAYS TO COUNCIL DAY BUT ONLY 535 DAYS FROM THE FIRST
ENUMERATION OF THE 2020 CENSUS WHICH WILL TAKE PLACE AS
TRADITIONALLY DOES IN A VILLAGE IN REMOTE ALASKA.
IN ADDITION TO THE 2018 TEST I CAN ALSO REPORT ADDITION KEY
DEVELOPMENT. WE CURRENTLY HAVE RELEASES TO
OUR ACOs AND 75 OF THE WAVE 2ACO s.
ONE IS SCHEDULED TO OPEN JANUARY 2019 AND WAVE 2 IS SCHEDULED TO
OPEN BETWEEN JUNE AND SEPTEMBER OF 2019.
AS A COMMUNICATION RESEARCH IS BEING COMPLETED THIS SUMMER,
WHILE WORKING WITH OUR CONTRACTORS AND CONTRACTING TEAM
TO BEGIN DEVELOPMENT OF OUR MEDIA PLANS AND MESSAGING AND
CREATIVE TREATMENTS THAT LIE AT THE HEART OF OUR ADVERTISING AND
PROMOTIONAL PROGRAM. THIS WILL ALLOW TO US HIT THE
GROUND RUNNING IN OCTOBER OF 2018.
WE’RE ACTIVELY RECRUITING SPECIALISTS NOW TO INCREASE OUR
LEVEL TO OVER 100 PARTNERSHIP SPECIALISTS BY THE END OF
SEPTEMBER AND AS I HAD MENTIONED EARLIER WE PLAN TO RAMP UP TO
1500 PARTNERSHIP SPECIALISTS OVER THE NEXT YEAR.
THIS IS NEARLY TWICE AS MANY PARTNERSHIP SPECIALISTS AS LAST
DECADE AND WE WILL TAKE STOPE ENSURE WE FURTHER IMPROV THEIR
WORK BY ENSURE WEG HAVE THE SKILL SETS WE NEED ACROSS THE
COUNTRY. WE’RE BUILDING PLANS TO HIRE
MEDIA AND LANGUAGE SPECIALIST AND LIAISONS AND PEOPLE WITH
SKILLS IN DIGITAL MEDIA AND WEB. THIS IS IN ADDITION TO EXPERTS
IN ON THE GROUND PARTNERSHIP WE HIRED IN THE PRIOR DECADE.
IT REFLECTS A MORE SOPHISTICATED APPROACH TO OUR WORK OF
PARTNERSHIP. IN ONE AREA SIGNIFICANTLY
IMPACTED I WANT TO MENTION THE PROGRESS IN COMPLETE COUNT
COMMITTEE AND COMMISSIONS. THOSE ARE AN ORGANIZATION PUT
TOGETHER BY A COMMUNITY OR A GOVERNMENT ENTITY TO DEVELOP AND
IMPLEMENT 2020 CENSUS AWARENESS CAMPAIGN BASED ON THEIR OWN
KNOWLEDGE OF THE LOCAL COMMUNITY TO ENCOURAGE A RESPONSE.
39 STATES MEANING D.C. AND PUERTO RICO HAVE FORMED 2020
COMPLETE COUNT COMMITTEES AND AN ADDITIONAL 11 STATES ARE
CONSIDERING FORMING THEY’RE IN THE PROCESS OF EVALUATING.
SOME STATES HAVE COMMISSION HAVE BEEN SET UP AND AUTHORIZED BY
LEGISLATION AND SEVERAL HAVE SOME THAT ARE THERE BY THE
GOVERNORS DECREE AND OTHERS ARE JUST PULLING THEM TOGETHER AS AN
ACTIVE PART OF THEIR FOCUS TO ENSURE THEY HAVE A COMPLETE
COUNCIL COUNT IN THEIR STATE. I JUST WANT TO DIGRESS FOR A
SECOND. I SPOKE TO THE U.S. CONFERENCE
OF MAYORS ON COMPLETE COUNT COMMITTEES IN THE CITY.
ONE OF THE MARRIES FROM — MAYORS FROM A NORTHERN STATE
ASKED TO SAY SOMETHING AND HE SAID IN 2000 HIS CITY WAS IN THE
BOTTOM FORTH OF THE STATE IN TERMS OF THEIR RESPONSE RATE TO
THE CENSUS. IN 2010, THEY PUT IN A COMPLETE
COUNT COMMITTEE AND HE SPENT $10,000 OF THE CITY’S MONEY ON
SIZE, SUBDIVISION AND EDUCATION CAMPAIGNS WITHIN THE CITY AND
FOUND RECENT PEOPLE DIDN’T RESPOND WAS THEY DIDN’T
UNDERSTAND IT MEANT SOMETHING FOR THEM.
THEY LOOKED AT IT AS A GOVERNMENT PROGRAM SOME PLACE
AND DIDN’T MEAN THE COMMUNITY CENTER ON THE CORNER THE STREETS
IN YOUR NEIGHBORHOOD ARE FUNDED BY MONEY GENERATED FROM THE
COUNT OF THE CENSUS. HE SAID ONCE HE EDUCATED THEM TO
THAT HE WAS IN THE TOP 25% OF ALL THE CITIES AND STATES IN
2010 AND IT GENERATED HIM $1 MILLION IN ADDITION REVENUE TO
THE CITY PER YEAR SINCE THE CENSUS STARTED AND TURNED TO THE
OTHER MAYORS AND SAID WHO WOULDN’T
WANT TO INVEST AND HE WAS MY BEST TESTIMONY.
HE GOT THE RESULTS. WE’RE ENCOURAGING STATES, SOCIAL
ORGANIZATIONS, COMMUNITY ORGANIZATIONS TO DEVELOP
COMPLETE COUNT COMMITTEES. WE LOOK AT THAT AS THE FORCE
MULTIPLIER. WHATEVER WORK WE’RE DOING FROM
GOVERNMENT FUNDING WE’RE ABLE TO AMPLIFY WHAT WE’RE DOING BECAUSE
NUMBER ONE WE’RE TRUSTED VOICES IN THAT COMMUNITY AND PEOPLE
TRUST THEM AND LOOK TO THEM FOR LEADERSHIP.
YOU’VE SEEN THIS SLIDE BEFORE. THIS SHOWS MAJOR CONTRACTS IN
PLACE IN SUPPORT OF THE 2020 CENSUS.
RIGHT NOW ALL BUT ONE OF OUR CONTRACT AWARDED IN THE CONTRACT
ADMINISTRATION PHASE AND THEY MAKE SURE CONTRACTORS ARE
MEETING THEIR PERFORMANCE OBJECTIVES FOR THE 2018 END TO
END TEST AND 2020 COUNCIL.
— CENSUS. THE ONE CONTRACT NOT IN PLACE IS
THE 2020 PRINTING AND MAILING CONTRACT AWARDED TO THE
COMPANY THAT EVENTUALLY FILED BANKRUPTCY UNDER CHAPTER 11. FOLLOWING THE PETITION THEY
ENGAGED IN DISCUSSIONS REGARDING THEIR RESTRUCTURING PROCESS
INCLUDING THE PROJECTED LIQUIDITY AND IMPACT WITH
RESPECT TO THE 2020 PRINTING AND MAILING CONTRACT.
THE UNITED STATES COULD BE — CONCLUDED IT WAS IN THE PUBLIC
INTEREST TO TERMINATE THEIR CONTRACT.
AFTER SEVERAL ROUNDS AND GOOD FAITH NEGOTIATION THE PARTIES
REACHED A SETTLEMENT FOR $5.5 MILLION.
ON JULY 26, THE BANKRUPTCY COURT APPROVED THE SETTLEMENT
AGREEMENT AND AMONG THE DEBTORS AND THE UNITED STATES FOR $5.5
MILLION PAYMENT TO SUNVEYO.
THEY WILL RESPONSE — CENVEO.
I WILL SAY CENVEO PROVIDE THE PRINT MATERIAL USED IN THE 2018
TEST. THE COMPLETE TERMS OF THE
SETTLEMENT HAVE BEEN ENTERED INTO BY ORDER OF COURT AND
PUBLICLY AVAILABLE. THE GOVERNMENT PUBLIC OFFICE IS
IN THE PROCESS OF PUTTING OUT A NEW SOLICITATION AND INTENDS TO
AWARD THE NEW CONTRACT BY NOVEMBER.
IT WILL ENSURE NO IMPACT ON THE 2020 MAILING OPERATION OR
OVERALL 2020 CENSUS SCHEDULE. ON AUGUST 1 THEY AWARDED THE
CONTRACT RESPONSIBLE FOR SHIPPING, PROVISIONING AND
SHIPPING, INSTALLING AND TESTING AND TRACKING EQUIPMENT AND
PROVIDING TECHNICAL SUPPORT FOR ALL THE FOR OUR 248 CENSUS
OFFICE AND DATA CAPTURE CENTER AND PUERTO RICO OFFICE AND
ISLAND OFFICE AND 1500 REMOTE WORKERS BASICALLY PARTNERSHIP
STAFF. THE CONTRACT IS ALSO RESPONSIBLE
FOR PROVIDING ON-SITE PERSONNEL AND SYSTEM ADMINISTRATION
SUPPORT OR ALL EQUIPMENT AND SOFTWARE IN OUR TWO DATA CAPTURE CENTER.
AND THE FITD CONTRACT IS RESPONSE IN FOR SANITIZING AND
RETURNING ALL EQUIPMENT TO ALL SITES.
THAT CONCLUDES MY OVERVIEW AND PAUSE NOW TO ASK IF THERE ARE ANY QUESTIONS.
SEEING NO QUESTIONS LET’S TURN TO KEVIN SMITH FOR AN UPDATE ON
CYBER SECURITY.>>GOOD AFTERNOON.
I WAS HERE LAST P.M.R. IN APRIL AND THOUGHT IT WAS VERY
IMPORTANT TO HAVE A FOLLOW-UP WITH CYBER SECURITY SO I’LL HAVE
A COMPLEMENT TO THE PREVIOUS PRESENTATION.
THERE’S BEEN CONVERSATION IN THE PUBLIC ABOUT SECURITY AND WHAT
THE CENSUS IS DOING TO SECURE DATA AND I WANT TO STRESS THAT
PROTECTION OF THE DATA WE COLLECT IS THE CENSUS’ HIGHEST
PRIORITY AND I’LL DESCRIBE IT’S NOT JUST THE TECHNOLOGY BUT THE
PEOPLE AND PROCESSES WE USE IN THE CULTURE WE GO THROUGH TO
HELP MAKE SURE EVERYONE’S AWARE OF THE IMPORTANCE OF THE DATA
AND TAKES ACTION TO PROTECT IT. THEN I’LL GO INTO IT AND
DESCRIBE MORE WHAT WE’RE DOING IN CYBER SECURITY.
ON THE FIRST SLIDE FROM DATA STEWARDSHIP, IT’S OUR FORMAL
PROCESS TO BASICALLY PROTECT DATA.
THIS IS NOT JUST WITHIN TECHNOLOGY.
IT’S WITHIN EVER ONE OF THE EMPLOYEE COMES TO WORK FOR THE
CENSUS AND CONTRACTORS. WE REALIZE OUR ABILITY TO STORE
AND SAVE AND PROTECT THE TASTE IS A TEAM EFFORT — PROTECT THE
DATA IS A TEAM EFFORT AND PROTECTING THE CONFIDENTIALITY
AND PRIVACY AND CONTINUALLY VALIDATING THAT AND IT’S NOT JUST WORDS.
THERE’S A FRAMEWORK BEHIND IT WHEN WE PRACTICE THIS ON A DAILY
BASIS. ON THE NEXT SLIDE ABOUT THE
OVERALL APPROACH, THE CENSUS CULTURE VAL TUESDAY DATA SECURITY.
WITHIN PHASE ONE WE CONTINUALLY EDUCATE OUR STAFF OF WHAT OUR
OBLIGATION TO PROTECT DATA, WE CHECK AND VALIDATE THIS AND
ENFORCE IT AND THERE ARE LAWS AND POLICIES WE FOLLOW AS CENSUS
EMPLOYEES AND CONTRACTORS TO MOVE THROUGH THE CYCLE.
WHEN WE LOOK AT IMPLEMENTING A SYSTEM AND WE HAVE COLLABORATED
ACROSS WITH PARTNERS IN THE GOVERNMENT AS WELL AS WITHIN THE
INDUSTRY TO MAKE SURE WE’RE PUTTING THE BEST THINGS FORWARD
TO SECURE THE DATA FROM A TECHNOLOGY ASPECT.
WE’RE ALSO COORDINATING USING THE SAME CYBER SECURITY
FRAMEWORK AND HOW YOU PROPERLY IDENTIFY ISSUES IN SECURITY AND
PROTECT AGAINST THEM AND REVIEW SOLUTION TO DETECT WHEN AN
ISSUE’S HAPPENING AND HOW YOU RESPOND AND RECOVER AS QUICKLY
AS POSSIBLE FROM THOSE EVENTS WITH THE LEAST AMOUNT OF RISK TO
THE DATA. WE FOLLOW THESE PROCESSES AND
THIS IS SOMETHING THAT TAKES A LOT OF COORDINATION ACROSS THE
GOVERNMENT AND SOMETHING WE DO AND WE TEST AND CONTINUALLY GO
THROUGH THE PROCESS TO MAKE SURE WE’RE ENGAGED IN THE RIGHT
FASHION TO FACILITATE THAT. THE TWO PLACES I’M GOING TO TALK
ABOUT REALLY IN MORE DEPTH IS ABOUT WHAT WE HAVE DONE TO
DESIGN SOLUTION ARE HELPING US CONTAIN CYBER THREATS AS SOON AS
THEY’RE DETECTED, SUSTAIN THE SERVICES THAT MAINTAIN THE
PUBLIC TRUST WE’RE LOOKING FOR FROM THE CENSUS ASPECT.
THIS IS SOMETHING KEY I TALKED AT A HIGH LEVEL ABOUT BUT DID
NOT GO INTO MORE DETAIL.
THE OTHER PIECE IS FROM THE MONITORING ASPECT AND WHAT ARE
THE PROCESSES WE ARE IMPLEMENTING TO DETECT WHEN
THREATS OCCUR AND WHAT ARE WHERE HE DOING TO PROTECT AGAINST
THEM. THIS IS ANOTHER AREA I’LL
DESCRIBE MORE IN DETAIL. ULTIMATELY IN PHASE TWO WHEN
WE’RE SECURING THE DATA AND COLLECTION BEEN SAID MANY YEARS
WE ARE USING DATA SECURITY FOR ENCRYPTION EVERYWHERE WE’RE
COLLECTING THE DATA. WE’RE ENCRYPTING IT IN TRANSIT
FROM YOUR COMPUTERS INTO THE CENSUS AND ENCRYPTING IT WITHIN
THE CENSUS AS THE DATA RESTS IN ALL THE PLACES WE STORE IT.
IT DOESN’T JUST RELY ON PERIMETER DEFENSES IN
NETWORKING. IT REALIZE ON PROTECTING THE
DATA AND I’M ENSURING THE DATA IS ENCRYPTED.
MOVING THROUGH AS WELL, I’LL DESCRIBE QUICKLY, WE DON’T JUST
ENCRYPT THE DATA, WE’RE USING A STRATEGY TO ISOLATE THE DATA
AWAY FROM THE PUBLIC INTERNET AS QUICKLY AS POSSIBLE.
IT’S KEY IN THE DESIGN FOR WHAT THE ENUMERATION DEVICES DO AND
INTERNET SELF-RESPONSE DOES. AS WELL, WE’RE CONTINUALLY GOING
THROUGH PROCESSES AFTER WE SECURELY RECEIVE THE DATA, GET
IT, ISOLATE IT TO VALIDATE IT AND WE’RE VALIDATING THAT WITH
PEOPLE AND PROCESSES IN TECHNOLOGY THAT LOOKS AT THE
TRANSACTIONS AND GOES THROUGH THE PROCESS WHICH IS SOMETHING
THE CENSUS HAS BEEN DOING FOR YEARS NOW.
WE ALSO GO THROUGH THE ASPECT OF GATHERING THE DATA.
WE’LL PROTECT THE CONFIDENTIALITY USING CONCEPTS
SUCH AS DIFFERENTIAL PRIVACY. AS PHASE 4 TALKS ABOUT WE HAVE
TO CONTINUALLY MONITOR AND RESPOND.
WE ALWAYS HAVE TO TEST THE MANTRA AND IT’S NOT JUST THE
TECHNOLOGY BUT THE PROCESSES WE FOLLOW.
WE HAVE TO MAKE SURE WE CONTINUALLY HAVE THE RIGHT LEVEL
OF COMMUNICATION WITH THE PUBLIC ABOUT WHAT WE’RE DOING THROUGH A
COMMUNICATIONS CAMPAIGN. THESE ARE THE THINGS WE’RE DOING
OVERALL FROM A STEWARDSHIP ASPECT OF DATA TO PROTECT WITH
DATA COMMUNICATION PROCESSES GOING FORWARD.
ON SLIDE SLIDE 13. I TALKED ABOUT THIS.
IN SPEAKING AT THE CENSUS NATIONAL ADVISORY COMMITTEES AND
SPEAKING AT THE CENSUS SCIENTIFIC ADVISORY COMMITTEES
AND WORKING WITH OUR PARTNERS IN THOSE GROUPS AS WE SHARE DATA
AND WITH THE ENGAGEMENT WITH THE DATA AS WE GO THROUGH THE
PARTNERSHIPS TO UNDERSTAND AND MANAGE THREATS.
AT A PUBLIC LEVEL IT’S STANDARD TO ONLY SHARE WHAT WE’RE DOING
AND DESCRIBE THAT. IT IS NOT STANDARD OR BEST
PRACTICE AND SECURITY TO SHARE THINGS LIKE WHAT ARE YOUR
SOLUTIONS, WHAT ARE THE PROTOCOLS YOU’RE FOLLOWING.
WHAT ARE YOU USING FOR TECHNOLOGY.
IT’S USING THE PLAY BOOK OUT THERE WHEN YOU DON’T WANT PEOPLE
TO SEE THE PLAY BOOK. I WANT TO ASSURE THE TEAM THE
PLAY BOOK IS SHARED WITHIN THE FEDERAL GOVERNMENT AND WITHIN
THE FEDERAL INTELLIGENCE COMMITTEE.
IT’S BEEN SHARED WITH THE FEDERAL CIO STAFF AND THE
COMMITTEE ASSISTING AND GUIDING MOVING THINGS FORWARD TO ENSURE
THE PROTECTION OF OUR DATA AND SHARED WITH INDUSTRY PARTNERS WE
WORK WITH ON A DAILY BASIS TO ENSURE PROTECTION.
IT’S NOT NECESSARILY SOMETHING YOU DESCRIBE AT A PUBLIC LEVEL
BUT I’LL DO MY BEST IN DESCRIBING SOME SOLUTIONS AS WE
GO TO PUT MORE CONTEXT BEHIND WHAT WE’RE DOING.
AND THERE’S A 95%/5% CONVERSATION OR RULE.
THE SECOND THING WE SAY IN SECURITY IS, IF IT’S ALREADY
HAPPENED AND SOMEBODY ALREADY FIGURED OUT IT’S A CYBER THREAT
IT’S IN THE 95% OF UNIVERSE OF WHAT’S AFFECTING YOU.
THE INDUSTRY SOLUTIONS KNOW WHAT THE THREATS ARE.
THEY ALREADY LOOK FOR THEM AND ALREADY DETECT THEM AND KIND OF
BLOCK THEM BEFORE THEY HAPPEN. SO ONCE SOMEONE’S ALREADY DONE
IT, INDUSTRY KNOWS ABOUT IT, PUTS IT IN THEIR PRODUCT SETS
AND WE’RE THEN COVERED AND PROTECTED FROM THE KNOWN THINGS PEOPLE DO.
AND IT’S THE 5% OF THE CYBER SPACE THAT’S UNKNOWN.
I WANT TO STRESS THE IMPORTANCE OF BEING WITHIN THE FEDERAL
GOVERNMENT AND A BUREAU WITHIN THE FEDERAL GOVERNMENT OFFERS US
INABILITY TO TYPE INTO THE 5% UNKNOWN SPACE WHICH IS EXTREMELY VALUABLE FOR US.
THE UNKNOWN SPACE ARE THINGS HAPPENING OR MIGHT BE SUSPECTED
FROM OTHER AREAS OF THE WORLD. THIS IS WHERE THE FEDERAL
INTELLIGENCE COMMUNITY GOES IN AND PROACTIVELY LET US KNOW
WHAT’S GOING ON WITHIN TO THE TOOLS OF RESOURCES TYPICAL
INDUSTRY DOES NOT KNOW. WE ARE DIRECTLY CONNECTED INTO
TAPPING INTO THIS RESOURCE TO PROACTIVELY GET IN FRONT OF
POTENTIAL CYBER THREATS THAT ARE NOT KNOWN IN THE GENERAL
INDUSTRY. THIS IS A VERY IMPORTANT CONCEPT
THAT’S AN EXTREME BENEFIT TO US FROM BEING IN THE FEDERAL
GOVERNMENT. ON THE NEXT SLIDE THIS IS
SOMETHING I BROKE INTO AND STATED AT THE LAST P.M.R. IS A
SUMMARY. I USED THAT OPPORTUNITY TO
BASICALLY STATE THERE ARE MANY THREATS WE CAN FACE WITHIN THE
CENSUS AND INSTEAD OF THREATS IN THE HUNDREDS IT’S EASIER TO TALK
THEM IN THE SEVEN HIGH-LEVEL CATEGORIES BECAUSE THEY RESORT
TO THIS. LAST TIME I TALKED ABOUT THE
FACT WITH EXTERNAL THREATS FROM THE END USER PERSPECTIVE WORKING
INTO THE CENSUS WE HAVE TO RELY ON THE INDUSTRY AND OTHER
FEDERAL AGENCY TO HELP US RESOLVE THE THREATS BECAUSE
THERE’S NOT A LOT OF THINGS WITHIN THE CENSUS’ DIRECT
CONTROLCONTROL UNTIL YOU GET IN THE WEBSITE AND RESPOND.
I DESCRIBE THIS AT A HIGH LEVEL. THE NEXT SLIDES WILL GO INTO
DETAILED DESCRIPTION I’LL SLOW DOWN ON.
I WANT TO MAKE SURE THIS ASPECT GENERALLY DESCRIBES WHAT EACH
ARE AND GET INTO THE DESCRIPTIONS OF SOLUTIONS.
SO COMPROMISING WITH A DEVICE. EVERY ONE OF US WILL RESPOND TO
THE CENSUS AND EACH ONE OF US WILL POSSIBLY USE A GOVERNMENT
OR CORPORATE DEVICE AND LOG IN TO A WEBSITE, HOPEFULLY, AND
RESPOND TO THE CENSUS. I AS THE CENSUS CIO AM NOT ABLE
TO PROTECT YOUR PERSONAL DEVICE BUT CAN MAKE SURE ONCE YOU GET
TO US THAT IS PROTECTED. I’LL GO THROUGH THE DESCRIPTION.
THERE’S A POINT WHERE WHEN YOU HAVE YOUR DEVICE WE’LL TRY TO
EDUCATE YOU AND WE RELY ON INDUSTRY AND OTHER AGENCIES.
WE’LL TRY TO GO THROUGH A PROGRAM TO PROTECT YOURSELF BUT
CAN ASSURE YOU WHEN YOU CONNECT TO US YOU ARE PROTECTED.
WHEN YOU GO THROUGH COMPROMISE ASPECT IT’S TELECOMMUNICATION
FIRMS IN THE WORLD TO HELP ROUTE IN THE U.S.
YOU HAVE TO MAKE SURE WHEN YOU SAY YOU’RE GOING TO THE CENSUS
YOU’RE GETTING TO US. IMPERSONATION OF THE CENSUS
TALKS ABOUT ROGUE WEBSITES AND PHISHING ATTEMPTS TRY TO GET —
FIRST-PERSONING FIRST-PERSONING — FISHING ATTEMPTS TRYING TO
GET YOU TO THE WRONG WEBSITE. AND IF SOMEONE’S USING THE
WEBSITE PROPERLY AND THE DATA’S SECURE WHAT DO WE MAKE SURE WE
GET THE RESPONSE WE WANT. I’LL GO THROUGH SOLUTIONS IN THE
NEXT SLIDES. ALL THOSE ARE EXTERNAL TO THE
CENSUS. WE CAN DETECT SOME BUT CAN’T
DIRECTLY RESPOND TO SOME AS THREATS.
THE CORE PEOPLE TYPICALLY TALK ABOUT IS WHAT ARE WE DOING TO
MAKE SURE NO ONE IS DISRUPTING THE SELF-RESPONSE SITE.
THE WORDS ARE FOR COMMUTER-GENERATED TRAFFIC TO
TRY TO MAKE THE SYSTEM BREAK.
DATA BREACHES MEANS THEY’RE TRYING TO PLUG THROUGH
TECHNOLOGICALLY AND BREAKTHROUGH AS MANY HOLES AS THEY CAN TO GET
TO THE TECHNOLOGY AND USE FISHING AND COMPROMISE THE
THREAT TO GET OR CHANGE THE DATA.
THE OTHER PIECE IS COMPROMISING EMPLOYEE DEVICES.
THE GENERAL GOVERNMENT FURNISHED
EQUIPMENT ARE DESK TOPS AND ENUMERATORS IN THE FIELD.
THAT COULD BE COMPROMISED SO THIS IS THE LAYOUT FROM THE TOP
HOW THEY COME IN AND HOW WE’RE GATHERING DATA ON THE BACK END.
THAT GENERALLY DESCRIBES THE SEVEN THREAT AREAS.
ON THE NEXT SLIDE IS GOING TO BE DESCRIBING WHAT WE DO AT EACH
ONE. I’LL INTEREST TRY TO — AND IT’S NOT JUST TECHNOLOGY AND
TOOLS TO SEE THINGS AND REACT, IT’S ALSO SPECIFIC THINGS WE DO
IN HOW YOU DESIGN A SYSTEM. SO WE’VE DESIGNED OUR SYSTEMS AND WE NEED TO SECURE
THE DATA FROM YOU AS A RESPOND ENT.
SECOND PRIORITIES ARE MAKING SURE THE USER EXPERIENCE THE
INTERACTION WITH THE CENSUS AND SELF-RESPONSE DOESN’T SUFFER DRAMATICALLY BY DOING SECURITY.
AND YOU CAN HAVE AN IMMENSE AMOUNT OF SECURITY EMBEDDED WITH
AN APPLICATION TO PROTECT THE DATA BUT AT THE SAME TIME THE
USER EXPERIENCE MAY SUFFER. THOSE ARE OPPOSING FORCES.
IT COULD BECOME SLOWER, BURDENSOME TO USE.
I WILL SAY CONFIDENTLY THAT USING THE CLOUD INFRASTRUCTURE
TO SUPPORT OUR SYSTEMS ENABLES US TO DO SOME THINGS TO CREATE A
BETTER BALANCE OF SECURITY AND USER PERFORMANCE BASED ON OUR
SPECIFIC DESIGN CRITERIA TO BASICALLY CONTAIN ISSUES AND
SUSTAIN SERVICES. WHAT THIS IS DOING IS GOING BACK
TO TYPICAL CONCEPTS, IF I HAD TO DESCRIBE IT NOT STATE IT, WE’RE
GOING BACK TO WHAT PHYSICAL SECURITY IS.
WHEN EVERYONE ENTERED THE BUILD ZAEG — BUILDING TODAY THERE
WERE LAYERS AND SECURITY FOR YOU TO GAIN ACCESS TO THE BUILDING.
THERE WERE DOORS YOU HAD TO GOOD THROUGH AND WALLS SURROUNDING
YOU TO MAKE SURE YOU’RE GOING INTO THE RIGHT PLACE AND YOU’RE
IN THE RIGHT LOCATION FIRST. THE GATES WERE THE ROOMS YOU HAD
TO GET THROUGH AND IT’S A TYPICAL SECURITY PRACTICE.
THERE ARE OTHER PLACES WHERE POSSIBLY THERE ARE ISOLATIONS
WHERE YOU SEPARATE DIFFERENT ROOMS.
YOU BASICALLY HAVE LINES AND GUARDS IN PLACE TO PLACE SOME
PEOPLE IN ONE ROOM AND THE NEXT SET IN THE NEXT ROOM AND PEOPLE
ARE WATCHING THE LINES, GUARD ARE WATCHING.
IF THEY SEE SOMETHING THEY DON’T LIKE, THEY CONTAIN THAT ROOM.
AND THEY CLOSE IT OFF STO THE ISSUE IS ISOLATED TO ONE LOCATION.
EVERYONE ELSE IN A DIFFERENT ROOM IS NOT AFFECTED.
ONCE YOUR INFORMATION IS SUBMITTED TO THE CENSUS JUST
LIKE ON THE ENUMERATION DEVICES WHICH I’LL DESCRIBE IN A SECOND
IS LOCKED DOWN BEHIND CLOSED DOORS.
IT IS VAULTED AND PUT INTO A SAFE THAT IS NOT ACCESSIBLE
OUTSIDE INTO THE PUBLIC. IT’S NOT EVEN VISIBLE.
SO THIS IS A STANDARD PRACTICE IN THE INDUSTRY THEY ACHIEVE AND
STRIVE FOR THAT WE ARE STRIVING AND ACHIEVING FOR SAME THING.
IT’S BEST PRACTICE DESIGN. THE WAY IT’S BEING DONE IS BASED
ON HAVING THE RIGHT VISIBILITY TO SEE WHEN AN ISSUE HAPPENS,
TAKE IMMEDIATE ACTION TO CONTAIN IT AND KNOWING THE DESIGN ITSELF
ALLOWS THE INTERNET SELF-RESPONSE OR ALLOWS THE
ENUMERATION SERVICES TECHNICALLY TO CONTINUE.
AND THE NEXT SLIDE, THESE ARE THE WORDS OF DESCRIPTION I USED
AS A VOICEOVER IN THE LAST P.M.R. AND USED IT AS A
VOICEOVER IN THE OTHER FORUMS I’VE BEEN IN.
THIS DATA HAS BEEN SHARED IN DEPTH.
I DID NOT GO BACK TO SAY THIS BUT SO WE HAVE HAD — I HAVE AS
WELL IN 2016 AND 2017, WE’VE BEEN THROUGH FEDERAL CYBER STATS
AND THE FEDERAL CIO AND THEIR SUPPORT STAFF WHO WE GO THROUGH
THE DETAILS OF WHAT WE’RE TRYING TO DO.
WE’VE HAD ROUND TABLES OF INDUSTRY AND OVERSIGHT TO GO
THROUGH THE INFORMATION ON AN OFF PUBLIC FORUM.
WE’VE HAD HEARINGS THAT HAVE DISCUSSED SOME TOPICS.
THE CURRENT YEAR IN THE PUBLIC DOMAIN WE DISCUSSED IN BOTH THE
NATIONAL ADVISORY COMMITTEE AND THE CENSUS ADVISORY COMMITTEE
THESE TOPICS GAINED FEEDBACK AND I DID THE P.M.R. IN 2018 AS WELL
AS TODAY AND WE’RE CONTINUING THE CONVERSATIONS IN DEPTH WITH
OUR FEDERAL PARTNERS AND INDUSTRY.
THESE ARE THINGS WITH MUCH BENEATH THIS TO BE SHARED TO
MAKE SURE THE RIGHT THINGS ARE BEING DONE.
FROM COMPROMISING RESPONDED DEVICE, WE ARE STORING MINIMAL
DATA ON THE DEVICE. THE CENSUS IS NOT STORING ANY
DATA ON YOUR RESPONDENT DEVICE OR COMPUTER OR MOBILE PHONE TO
COLLECT DATA OR SUBMIT DATA TO THE INTERNET SELF-RESPONSE TOOL.
IF YOU CHOOSE AS A RESPOND ENT ON YOUR DEVICE TO STORE DATA
LOCALLY OR CACHE IT THERE’S NOT MUCH I CAN DO TO STOP YOU FROM
CACHING THE DATA. WE WILL GO THROUGH A PUBLIC
CAMPAIGN AND GO THROUGH COMMUNICATION TO LET YOU KNOW
THE DANGERS OF THE RESPONSES. THAT’S UP TO YOU WITH THE WAY
YOU USE YOUR INTERNET BROWSER AND HOW YOU CONNECT TO THE REST
OF THE INTERNET. I WILL SAY ONCE YOU CONNECT TO
THE INTERNET SELF-RESPONSE SITE ALL THE COMMUNICATIONS BETWEEN
YOUR DEVICE AND OUR WEBSITE IS 100% ENCRYPTED IN THAT
TRANSMISSION FROM YOU TO US.
IT CAN’T BE SEEN OR TAKEN. THE DATA’S IN AN ENVELOPE AND
CAN’T BE READ. FROM THE INTERNAL/EXTERNAL
ACCESS WE’RE LOOKING FOR UNAUTHORIZED CONNECTION ATTEMPTS
AND WE’RE GOING TO NEED AND WILL HAVE TO WORK WITH THE INDUSTRY
TO ENSURE IF YOU ARE BEING ROUTED TO THE RIGHT WEBSITE IS
THAT IN THE INDUSTRY OR BECAUSE THERE’S A ROGUE WEBSITE YOU’RE
BEING DIRECTED TO? WHAT WE DON’T WANT TO HAVE
HAPPEN IS YOU’RE SUPPOSED TO BE GOING TO THE CENSUS SITE AND FOR
SOME REASON A LARGE INDUSTRY PLAYER WHO’S A
TELECOMMUNICATIONS FIRM HAD A BROACH AND IT’S BEING ROUTED TO
THE WRONG PLACE. THOSE ARE THE THINGS WE’RE
TALKING ABOUT AND WORKING WITH INDUSTRY.
IMPERSONATION OF THE COUNCIL. WE’RE PROACTIVELY IDENTIFYING A
ROGUE WEBSITE. IT’S BASICALLY A FAKE WEBSITE OF
THE COUNCIL. WE HAVE ALREADY WITHIN THE
COMMUNICATION ORGANIZATION AT CENSUS PURCHASED MANY WEBSITE
NAMES AND DOMAINS PEOPLE COULD USE, WOULD USE THAT LOOK LIKE THE CENSUS.
ULTIMATELY SOMEONE MAY COME UP WITH A WEBSITE AND TRY TO POINT
YOU TO THAT WEBSITE. WE HAVE DETECTIONS OF THESE
WEBSITES AND THERE ARE FEDERAL PROCESSES WE FOLLOW THROUGH ONCE
IDENTIFIED TO GO THROUGH THE FEDERAL GOVERNMENT TO GO THROUGH
THE CLOSURE OF THOSE SITES. ULTIMATELY AS I SAID BEFORE,
THIS IS AN EXTERNAL THREAT. WE’LL PROACTIVELY COMMUNICATE
THIS AS SOON AS POSSIBLE WHEN WE SEE THEM TO EDUCATE THE PUBLIC
BUT WE’RE NOT NECESSARILY IN DIRECT CONTROL TO SHUT DOWN A
WEBSITE BUT WE’LL LET PEOPLE KNOW IF THAT HAPPENS AND LET
PEOPLE KNOW AS QUICKLY ADDS POSSIBLE.
INVALID RESPONSE. WE HAVE AN AUTOMATED ANALYSIS OF
OUR INDIVIDUAL RESPONSES. LOOKING AT SOCIAL MEDIA AND
OTHER PLACES TO DETERMINE IS THIS AN ACCURATE RESPONSE OR
SHOULD WE FLAG THIS FOR FURTHER FOLLOW-UP.
THIS IS WHERE PEOPLE AND PROCESSES COME IN.
WE’LL BE FLAGGING AND TAGGING SOME OF THE RESPONSES THAT COME
IN AND LOOKING AT THEM TO DETERMINE ABOUT WHAT WE THINK.
IS IT IRREGULAR OR NOT AND IT’S SOMETHING DONE WHEN IT WAS PAPER
AS WELL. WE’LL BE LOOKING AT THE ANALYSIS
OF THE IRREGULARITIES AND TAKING ACTION AND ALSO LOOKING AT DATA
FLOW ANALYSIS. IS TOO MUCH DATA COMING IN FROM
ONE PLACE OR NOT? THAT’S WEIRD.
THERE’S THINGS WE’LL BE WATCHING TO MAKE SURE THE DATA MATCHES
OUR EXPECTATIONS COMING IN BUT IT’S A PROCESS THAT HAS TO BE
FOLLOWED WITH PEOPLE AND EYES ON IT TO VALIDATE THE RESPONSES.
ON THE NEXT SLIDE ARE THINGS THAT ARE INTERNAL THREATS TO THE
CENSUS. THESE ARE THINGS WHERE I’LL
DESCRIBE THE SOLUTIONS, TECHNOLOGIES AND PROTOCOLS BUT
WE’RE NOT GOING TO BE TALKING FURTHER ABOUT THEM.
OUR PARTNERS KNOW ABOUT THEM AND WORKING WITH THEM BUT IN A
PUBLIC FORUM, DISRUPTION TO THE INTERNET SELF-RESPONSE SITE AND
WE’LL BE ABLE TO TAKE ACTION IN THOSE, I’LL SAY BASED ON THE
SOLUTION DESIGN DESCRIBED WE’LL BE ABLE TO SUSTAIN SERVICES.
IF WE’RE MONITORING FOR TRAFFIC SITES AND CAN CONTINUALLY GROW
THE SYSTEM TO MAKE SURE IT’S ALWAYS WORKING WE HAVE A
COMPLIMENT AND MITIGATION TO THIS.
PROACTIVE MITIGATION OF ROBOT. WE’LL USE OUR TECHNOLOGY WITH
OUR PROVIDERS THAT CONNECT AND HAVE DDOS SERVICES THAT DETECT
THESE THINGS. WE’LL HAVE THINGS THAT ASK YOU
UP FRONT ARE YOU A ROBOT OR NOT. THEY’RE CALLED CAPTURE.
THEY’RE KNOWN STANDARDS. ALL THESE THINGS ARE IN PLACE TO
MITIGATE AGAINST JUST A TYPICAL AUTOMATED ATTACK.
WE’RE ALSO GOING TO BE WORKING WITH THE CYBER THREAT
INTELLIGENCE CREW AND LOOKING IF SOMEONE’S COMING AT YOU.
DID WE SEE IN SOCIAL MEDIA SOMEONE’S TRYING TO COME AT US?
SOMETIMES BEING AHEAD OF THE GAME IS THE BEST ATTACK AND
APPROACH. THE MORE WE CAN KNOW ABOUT THIS
UNKNOWN AREA OF THREATS, THINGS YOU MAY NOT SEE INITIALLY BUT
SOMEONE ELSE HAS THEIR EYES ON IT AND FOCUS, THE BETTER WE’LL BE.
I MENTION THE BULLET OF DESIGNED TO SUSTAIN RESPONSE.
WE HAVE THE ABILITY TO CONTINUALLY SUSTAIN THE SERVICES
BASED ON THE DESIGN WHICH CAN MITIGATE SOME OF THESE AS WELL.
THERE ARE DISTRIBUTED DENIAL PROTECTION SERVICES FROM
TELECOMMUNICATIONS PROVIDERS AS WELL AS FROM OUR WEBSITE.
WE HAVE SOLUTIONS IN PLACE TO OFFLOAD THE INITIAL ATTACK OF
OUR WEBSITE TO AN INDUSTRY LEADER WHO DOES THIS ON A DAILY
BASIS. AND THEY WILL BE THE FIRST LINE
OF DEFENSE BEFORE THEY FILTER OUT THE ROBOTS AND THE PROBLEMS
AND THINGS AND THEN THEY COME TO US TO HANDLE.
SO WE HAVE MANY LAYERS OF SOLUTIONS IN PLACE TO FUNNEL IN
THE NON-WANTED TRAFFIC INTO WHAT WE WANT TO COME TO OUR WEBSITE.
DATA BREACHES IS THE BIG AREA. DATA BREACHES TO THE CENSUS IS
NOT JUST THE RISK OF SOMEONE TAKING DATA FROM THE CENSUS.
IT’S ALSO THE RISK OF SOMEONE GOING THROUGH A NON-NATURAL PATH
AND UNEXPECTED PATH. WE EXPECT PEOPLE TO FOLLOW THE
INTERNET SELF-RESPONSE SITE AND ENTER THROUGH THE WEBSITE AND
SUBMIT IT. WE DON’T WANT PEOPLE TO COME
INTO THE SITE AND CHANGE THE DATA WITHOUT GOING THROUGH THE
NATURAL FLOW OF THE SYSTEM WE WANT.
WE’LL BE WATCHING FOR THAT AND DETECTING IT.
WE’LL BE AT THE SAME TIME MONITORING FOR UNAUTHORIZED
ACCESS. THAT’S WHAT THAT WAS SPEAKING
ABOUT. WE’LL MAKE SURE YOU ARE SUPPOSED
TO BE GOING THROUGH THE SITE THE RIGHT WAY TO PUT DATA IN.
IF WE SEE SOMETHING WE DON’T LIKE, WE IMMEDIATELY CONTAIN IT
NO QUESTIONS ASKED. WE MONITOR FOR IRREGULAR DATA
FLOWS. IF WE SEE DATA FLOWING THE WRONG
WAY OR IN AN IRREGULAR PATTERN WE DON’T LIKE, WE WILL CONTAIN
IT AND FIND OUT LATER WHAT’S GOING ON.
THE SUSTAINMENT OF SERVICES WILL ALLOW PEOPLE TO RESPOND AND OUR
ABILITY TO CONTAIN THE ISSUE MEANS DATA WILL NOT BE AFFECTED.
WE HAVE PROTECTED IT. ALSO IN THIS CASE IN DATA
BREACHES, ENCRYPTION OF DATA AND THE BEST PRACTICES WE HAVE
FOLLOWED WITH ALL OF OUR DATA NOT JUST FOR 2020 DATA FOR THE
2020 CENSUS. THE DATA SITTING INSIDE THE
NETWORKS RESPOND IS ENCRYPTED AND LOCKED IN A VAULT
AFTER SUBMITTED. IT’S TAKEN OFF THE INTERNET VERY
QUICKLY. WE CONTINUALLY GO THROUGH SYSTEM
APPLICATION AND PENETRATION TESTING WITH INDUSTRY LEADERS AS
WELL AS THE FEDERAL GOVERNMENT.
LAST YEAR WE HAD LEADERS GO THROUGH A PENETRATION TEST WHICH
IS TRY TO BREAK IN BIG BRUTE FORCE LAST YEAR AND THIS YEAR.
THIS YEAR WE HAD THE DEPARTMENT OF HOMELAND SECURITY GO THROUGH
PENETRATION TESTING OF NOT JUST OUR INTERNET SELF-RESPONSE SITE
TRYING TO BREAK IN TO THE CELL PHONES AND MAP LINK APPLICATIONS
LISTING THE U.S. INTO ALL OF THE DEVICES AND SOLUTIONS TO COLLECT
DATA FOR THE 2020 CENSUS. CRITICAL OR HIGH FOUNDINGS WERE
FOUND IN THIS BOTH FROM THE INDUSTRY AND HAD D.H.S. AND
WE’RE CONTINUALLY GOING THROUGH AND SECURING THE SOLUTION IF WE
FOUND SOME THINGS THAT ARE AT A LEVEL WE NEED TO CORRECT BUT
NOTHING MAJOR WAS DISCOVERED, NO DATA WAS ABLE TO BE TAKEN
BECAUSE OF THE DESIGN AND THE WAY TO GO THROUGH AND DO THINGS
BECAUSE OF THE DILIGENCE OF THE PROCESS AS WE CONTINUALLY KEEP
SYSTEMS UP TO DATE.
SYSTEM SECURING AND MONITORING ANALYTIC.
WE HAVE ALL THE TOOLS TO MONITOR ABOUT WHAT IS HAPPENING IN EACH
SERVER AND APPLICATION AND WHAT LOOKS IRREGULAR AND RIGHT.
THAT’S THE 95% SOLUTIONS. THE INDUSTRY SOLUTIONS THAT KNOW
95% OF THE ISSUES ARE WATCHING FOR THOSE THINGS.
WE HAVE THESE IN PLACE. WE’RE ALSO TAKING THOSE AND
TAKING THOSE TOOLS AND NOT JUST LOOKING FOR THE 95% STUFF, WE’RE
TAKING THE TOOLS TO THEN SHOW US WHERE THERE’S AN IRREGULAR DATA
FLOW AND SHOW US WHERE SOMETHING’S HAPPENING WE DON’T
LIKE TO TECHNICALLY SEE AND IDENTIFY A PATTERN WE DON’T
LIKE. WE’RE USING THE TOOLS TO
IDENTIFY THAT. TIMELY PATCH MANAGEMENT.
WHEN WE IDENTIFIED THERE’S AN ISSUE, WE ARE CONTINUALLY
SCANNING THE TECHNOLOGY. THIS IS TYPICAL PRACTICE.
YOU SCAN A SYSTEM IN THE TECHNICAL CONFIGURATION AND IF
SOMETHING POPS UP THAT SAYS THE CONFIGURATION NEEDS TO CHANGE,
WE CHANGE IT. THESE ARE THINGS THAT IDENTIFIED
THROUGH A PROCESS OF CONTINUALLY MAKING SURE YOUR TECHNOLOGY IS
CONFIGURE THE RIGHT WAY. THIS IS DONE NOT JUST BY THE
CENSUS BUT THE DEPARTMENT OF HIMLAND SECURITY SCANS OUR
PUBLICLY ADDRESSABLE SYSTEMS AND WE HAVE TRANSPARENCY AND
ACCOUNTABILITY OUTSIDE THE CENSUS LOOKING FOR THIS.
IT IS ALSO THE FRTHD.
AND WE ARE CONTINUOUSLY LOOKING FOR FISHING
ATTACKS, ATTEMPTS, EVERYONE CONTRACTING AS WELL THE
QUALITY OF DATA. THIS IS IMPORTANT BECAUSE
TECHNOLOGY ALONE CAN STOP SO MUCH BUT PEOPLE SEEING SOMETHING
AND SAYING SOMETHING AND THAT’S SOMEONE ELSE’S TAGLINE, IT’S IMPORTANT IN SECURITY AND
THE QUICKER YOU CAN DO THAT IS BETTER OFF YOU’LL BE.
THAT’S ENGRAINED IN US HERE AT THE OFFICE OF THE CENSUS.
ANOTHER THING HERE IS CONTINUE — WE’LL HAVE A PROACTIVE
OUTREACH AND AWARENESS CAMPAIGN. WE’LL LET PEOPLE KNOW WHAT WE’RE
DOING AND WHY AND HOW IT RELATES TO THEM.
I’LLET YOU KNOW THE DESIGN WE HAVE MEANS THE DATA WON’T GO
ANYWHERE. WE’LL HAVE A HANDLE ON THAT.
AND SO IN THE OUTREACH AND AWARENESS IT’S MAKING PEOPLE
FEEL COMFORTABLE I MOVE FORWARD FROM A DESIGN ASPECT.
THE LAST SECTION THE COMPROMISE OF
EMPLOYEE’S DEVICES AND CONTRACTORS AND WHAT WE GOING TO
ALL THE DEVICES FOR ENUMERATORS WHO ARE ON A PART-TIME BASIS
COLLECTING INFORMATION FOR THE CENSUS?
DATA IS ENCRYPTED IN TRANSIT AND AT REST.
FROM A CELL PHONE ENUMERATION. DATA IS ENCRYPTED ON IT AND WHEN
IT’S TRANSFERRED BACK TO THE CENSUS.
IF SOMETHING HAPPENS ON THIS DEVICE WE DON’T LIKE BECAUSE
WE’RE WATCHING IT WE CAN REMOTELY WIPE IT AND CLEAN ALL
THE DATA AND SYSTEMS AND TECHNOLOGY OFF OF IT.
ONE KEY THING NOT MENTIONED HERE I’D LIKE TO STATE AGAIN IS THE
KEY DESIGN FACTOR HERE IN THE ENUMERATION TOOLS IS SIMILAR TO
THE DESIGN FACTOR IN THE INTERNET SELF-RESPONSE TOOL.
ONCE THE ENUMERATOR COLLECT THE DATA ON THE DEVICE AND HITS
SUBMIT, THE DATA IS OFF THE DEVICE.
IT IS GONE, IT IS REMOVED, IT IS LOCKED AWAY IN A VAULT INSIDE THE CENSUS.
THE EXPOSURE IS MINIMAL BECAUSE THERE’S NOT GOING TO BE A LOT OF
DATA ON THE PHONE. IT’S GOING TO REMOVE ITSELF AS
SOON AS IT’S CONNECTED TO THE NETWORK.
WE’RE MONITORING THE ACTIVITY AND WE’RE USING AUTHENTICATION
INTO THE DEVICES AND GOING THROUGH A COMPLEMENT OF FISHING
TESTS TO MAKE SURE PEOPLE KNOW WHAT TOO DO.
THE DEVICES AND ENUMERATION ARE RESTRICTED TO SPECIFIC AREAS
THEY CAN GO AND NOT LOGGING INTO THE NETWORK OF CENSUS.
THEY DO NOT HAVE ACCESS TO THE DATA OF THE CENSUS.
THEY ARE SIMPLY AN INPUT SUBMISSION DEVICE AND IT MANAGES
THEIR WORK LOAD. THE DATA ON THAT IS REMOVED
QUICKLY AND NOT A THREAT TO THE OVERALL CONFIDENCE OF WHAT WE’RE
DOING TO PROTECT THE DATA BECAUSE THE DATA ITSELF IS NOT
ON THE PHONE. A LOT OF THE TWO FACTOR
AUTHENTICATION AND MECHANISMS DISCUSSED PREVIOUSLY IS WHAT ARE
YOU DOING PROTECT THE DATA? WELL, THEY’RE ALL STANDARD
PRACTICE IN ANY CENSUS EMPLOYEE LOGGING INTO FEDERAL NETWORK.
THERE’S A DISTINCTION IF YOU’RE LOGGING INTO A FEDERAL NETWORK
OR NOT AND I WANT TO MAKE THAT CLEAR AS MY LAST POINT.
AND SO FROM THE STANDPOINT OF MY SUMMARY, MR. FONTENOT, I’M DONE.
I’M OPEN FOR QUESTIONS AND I’LL DO MY BEST WITH THAT.
>>HI, MARYANN FROM THE DEPARTMENT OF COMMERCE.
I’M CURIOUS WITH THE IDENTIFICATION OF ROGUE
WEBSITES. SIT PART OF YOUR PLAN — IS IT
PART OF YOUR PLAN TO SHARE THAT WITH INDUSTRY PARTNERS TO STOP
THE THREAT OF SUCH CAMPAIGNS ON THEIR OWN PLATFORM?
>>WE HAVE THE SERVICE TO MONITOR THE WEBSITES.
AND STOPPING IT IS SOMETIMES DIFFICULT.
WE WILL LOOK AT ENGAGING INDUSTRY TO SEE WHAT THEY CAN DO
TO BLOCK THE ACCESS TO THESE BUT IT’S A HARDER PROBLEM THAN YOU
WOULD THINK TO RESOLVE AND THAT’S WHERE WE THINK A LOT OF
IT AS AN APPROACH OF COMMUNICATING QUICKLY IS A
QUICKER PATH THAN ATTEMPTING TO TECHNICALLY BLOCK SOME OF THIS.
IT’S A DIFFICULT PROBLEM.
>>OTHER QUESTIONS? IF NOT, THANK YOU VERY MUCH,
KEVIN. WE APPRECIATE IT.
AT THIS POINT WE ARE GOING TO GO TO DEB STEMPOWSKI AND HER AND
HER TEAM WILL TALK ABOUT THE TEST THAN I PERFORMED IN THE
INTRODUCTION.>>THANKS, AL.
THANKS EVERYBODY FOR BEING HERE TODAY.
I WAS LISTENING TO AL’S OPENING REMARKS.
THOUGH A CENSUS IS A MAJOR UNDERTAKING WITH MANY MOVING
PARTS THE 2018 CENSUS TEST HAS BEEN A MAJOR UNDERTAKING AND HAS
A LOT OF PARTS TOO IN CASE YOU’RE WONDERING.
WE’LL FOLLOW ON THE STRATEGY I LAID OUT IN THE P.M.R. AROUND
THE 2018 TEST. THIS WILL BE AN AGILE UPDATE
WHERE WE’LL TALK ABOUT THINGS THAT JUST HAPPENED AND SOME WILL
ROLL OFF AND WE WON’T TALK ABOUT THEM IN OCTOBER BECAUSE WE’LL BE
INTO ANOTHER PART OF THE TEST. HERE’S OUR OLD FRIEND THE PLACE
MAT. IT’S STILL HERE.
NOTHING’S CHANGED. WHAT HAS CHANGED IN THE 2018
TEST UPDATE IS I’M NOT GOING TO DO ALL THE TALKING.
SO I’M PLEASED TODAY TO HAVE THREE LADIES FROM MY TEAM HERE
TO TALK ABOUT SELF-RESPONSE, NON-RESPONSE FOLLOW-UP AND WE
START THE GROUP QUARTERS OPERATIONS FOR 2018 BUT I
THOUGHT BEFORE I LEFT THIS SLIDE AND TURNED IT OVER TO ALEXA IT
WOULD BE APPROPRIATE HERE TO THANK NOT ONLY THESE LADIES AND
EVERYBODY ELSE IN THE BUILDING WHO EXECUTED THE TEST AND ALSO
GIVE A SPECIAL OUT TO THE NATIONAL PROCESSING CENTER, THE
NEW YORK REGIONAL OFFICE AND PROVINCE CENSUS OFFICE AND ALL
THE PEOPLE ON THE GROUND KNOCKING ON DOORS COLLECTING
DATA NO MATTER WHAT HAPPENED OR WHAT THE WEATHER WAS THEY WERE
OUT GETTING THE JOB DONE. A BIG THANKS TO THE MANY MOVING
PARTS AND PIECES THAT HELPED US PULL OFF MUCH OF THE OPERATIONS IN THIS TEST.
[APPLAUSE] I’M GOING TO TURN IT OVER TO
ALEXA TO TALK ABOUT SELF-RESPONSE.>>THANK YOU.
>>IN THIS PORTION OF OUR PRESENTATION I’LL BE COVERING A
COUPLE THINGS. YOU CAN SEE THE AGENDA UP HERE.
I’LL COVER THE KEY COMPONENT OF THE OPERATIONAL TESTING
CONDUCTED IN 2018. WE’LL TAKE A QUICK PASS TO THE
2018 MAIL STRATEGY AND SAMPLE CHARACTERISTIC AS THAT’S LIKELY
FAMILIAR TO MOST AND GET TO THE EXCITING PART LOOKING AT THE
RESULTS FROM THE 2018 END-TO-END CENSUS TEST AND SEE AN EVERY
VIEW OF SELF-RESPONSE AND MODE AND PANEL AND SELF-RESPONSE BY MODE OVER
TIME AND HOW THE CENSUS PERFORMED AND TALK ABOUT THE
PARTNERSHIP ACTIVITIES CONDUCTED WITH THE UNITED STATES POSTAL
SERVICE AND WHAT WE’RE DOING TO BUILD ON THE SUCCESSES OF THE
2018 TEST AND FINALIZE OPERATION FOR THE 2020 CENSUS.
OUR GOAL WAS TO BUILD ON PRIOR TEST EFFORTS TO FURTHER IMPROVE
AND REFINE OUR SELF-RESPONSE OPERATIONS.
AS YOU KNOW, SELF-RESPONSE HAS BEEN RUNNING IN THE PRIOR CENSUS
TESTS AND WE WANTED TO USE OUR LAST CHANCE TO RUN SELF-RESPONSE
AGAIN AND DO TWEAKS AND IMPROVE IT FURTHER.
FOR INTERNET SELF-RESPONSE WE UTILIZED THE SELF-RESPONSE
INSTRUMENT AVAILABLE IN ENGLISH AND SPANISH AND CQA PROVIDED
ASSIST JANS TO THE PUBLIC BY ANSWERING QUESTIONS TO THE TEST
AND TAKING RESPONSES OVER THE PHONE.
OUR INTERACTIVE VOICE RESPONSE SYSTEM WAS ACTIVE AND WE HAD
LIVE AGENT WORKING CALLS NOR SELF-RESPONSE PORTION.
FOR WE HAD FORCE IN ENGLISH, SPANISH, CHINESE, VIETNAMESE,
RUSSIAN AND ARABIC. OUR DATA PAPER CAPTURE AT OUR
NATIONAL PROCESSING CENTER USED SCANNING EQUIPMENT FOR THE 2018
TEST. THIS IS ALSO THE FIRST TEST
WHERE WE WERE ABLE TO SET UP THE DATA CAPTURE OPSES AND DEDICATED
SPACE AND USED IT TO REFINE THE PROCESS.
THE OPERATION WHICH IS RESPONSIBLE FOR THE PRINTING AND
MAILING COMPONENTS OF SELF-RESPONSE WAS ABLE TO REFINE
THE OPERATIONAL APPROACH INCLUDING THE PRINT MAIL
PROCEDURE AND QUALITY CONTROL PROCEDURES.
THIS SLIDE WILL LIKELY LOOK FAMILIAR SHOWING THE SAMPLE
CHARACTERISTIC OF THE 2018 END-TO-END CENSUS TEST.
IT WAS CONDUCTED IN PROVINCE COUNTY, RHODE ISLAND AND
INCLUDED NEARLY 280,000 HOUSING UNIT.
EACH WAS ASSIGNED TO ONE OF TWO PANEL.
ABOUT 70% OF THE HOUSING UNITS WERE ASSIGNED TO THE INTERNET
FIRST PANEL AND THEY RECEIVED A LETTER AS PART OF THEIR INITIAL
CONTACT. ABOUT 30% OF THE HOUSING UNITS
WERE ASSIGNED TO THE INTERNET CHANNEL ALONG WITH INFORMATION
ON HOW TO RESPOND BY PHONE OR ONLINE.
UP TERMS OF THE LANGUAGES 30% RECEIVED MATERIALS IN ENGLISH
ONLY AND 27% RECEIVED BILINGUAL STJ AND WE DIVIDED THE
PANEL INTO THREE COHORTS AND STAGGERED THE MAILINGS BY
COHORT. THE FIRST RECEIVED THEIR MARCH
16th AND THE FINAL COHORT RECEIVED IT MARCH 23.
IN 2020, THE STAGGERED MAIL STRATEGY WILL HELP SMOOTH THE
WORK LOAD OUT FOR THE PARTICIPANT AND SELF-RESPONSE
OPERATIONS OVER THE PERIOD OF THE CENSUS.
IN PARTICULAR WE PAID SPECIAL ATTENTION TO THE WAYS TO STAGGER
TO EASE THE BURDEN ON THE CALL CENTERS ESPECIALLY AT THE
BEGINNING OF THE CENSUS PERIOD. SIMILAR TO PAST TESTS, IN 2018
THE NON-RESPONSE ENTS RECEIVED MAILING THREE THROUGH FIVE.
THE FIRST LINE WITH TOTAL VOLUMES SHOWED THE DROP OFF IN
MAILED MATERIALS AS MORE RESPONDED.
AND THIS IS A MANAGEMENT ALL RIGHT REPORT
TO LOOK AT SELF-RESPONSE ENUMERATION AREA OR T.E.A.1
STARTED MARCH 16. INTERNET AND SELF-RESPONSE ENDED
JULY 31st. PAPER DATA CAPTURES AND
SELF-RESPONSE ARE STILL UNDERWAY AND THE DATA ON THESE SLIDES
REPRESENT ESSENTIALLY SELF-RESPONSE.
THE TOP SHOWS RESPONSE RATES OVER TIME THE SOLID BLUE AS WELL
AS THE PROJECTED RESPONSE RATES THE DOTTED LINE.
AT THE BEGINNING WE WERE TRACKING CONSISTENT WITH OUR
EXPECTATIONS AND ANOTHER BUMP AROUND CENSUS DAY APRIL 1st AND
WHEN THE INTERNET FIRST PANEL WAS RECEIVING PAPER
QUESTIONNAIRES WE DID NOT SEE A RESPONSE COME IN AS STRONGLY AS
INITIALLY ANTICIPATED. THIS IS SOMETHING WE WATCHED
CLOSELY APPROACHING THE NON-RESPONSE FOLLOW-UP.
AS YOU CAN SEE IN THE SECOND VERTICAL LINE WE CLOSED MOST THE
GAP BY THE TIME WE STARTED. WE OUTPERFORMED EXPECTATIONS
COMPARED TO PROJECTION OF 49.3%. AND THERE’S THE UPDATE LEAVE
AREA. I’LL TALK MORE ABOUT T.A.1 IN A
MINUTE SO FOR NOW WE’LL LOOK AT UPDATE LEAVE.
IT BEGAN APRIL 9th. WE HAD A PAPER QUESTIONNAIRE
DELIVERED TO THE DOOR AND THE INITIAL WORK LOAD FOR UPDATE
LEAVE WAS 1800 HOUSING UNITS. OF THOSE 633 OR 37%
SELF-RESPOND. GIVEN THE PROJECTED
SELF-RESPONSE WAS 31% WE WERE PLEASED WITH THE RESULT AND THE
MAJORITY OF RESPONSE CAME IN THE FORM OF PAPER QUESTIONNAIRES.
THIS TABLE WE HAVEN’T SHOWN BEFORE BUT THE DATA IS THE DATA
MOST FREQUENTLY ASKED ABOUT. IT SHOWS SELF-RECEIVE BY PANEL
AND MODE AND PROJECTIONS FOR 2018.
ON THE LEFT SIDE YOU CAN SEE THE MODE AND TOP LINE IS TOTAL
RESPONSES ALL MODES FOLLOWED BY INTERNET, PHONE AND PAPER.
ACROSS THE TOP YOU CAN SEE WE HAVE VOLUME AND PERCENT OF
RESPONSES FOR THE TOTAL OF BOTH PANELS THE INTERNET FIRST AND
INTERNET CHOICE PANEL. OVERALL 61% OF SELF-RESPONSE
CAME IN VIA THE INTERNET AND 31% BY PAPER.
WHEN WE LOOK ACROSS WE SAW WHAT WE EXPECT THE MAJORITY OF
RESPONSES WERE SUBMITTED ONLINE. WE WERE ALSO PLEASED TO SEE 34%
OF THE RESPONSES FROM THE INTERNET CHOICE PANEL WERE
SUBMITTED VIA THE INTERNET SELF-RESPONSE INTERNET.
GIVEN THEY HAD A PHYSICAL PAPER QUESTIONNAIRE IN THEIR HAND FROM
THE BEGINNING WE WERE PLEASED TO SEE SO MANY INTERNET RESPONSES FROM THE PANEL.
THIS GRAPH SHOWS SELF-RESPONSE BY MODE OVER TIME FROM THE
BEGINNING OF SELF-RESPONSE FROM MARCH THROUGH YESTERDAY.
BLUE LINE SHOWS ALL RESPONSES ACROSS ALL MODES AND THE
RESPONSES DID SO FROM THE BEGINNING AND WE DID RECEIVE
ONLINE RESPONSES THROUGH JULY 31st.
LOOKING AT THE ORANGE LINE KEEP IN MIND 30% OF HOUSING UNITS
RECEIVED PAPER IN THEIR FIRST MAIL.
PAPER FORMS WERE DELIVERED BETWEEN APRIL 12 AND APRIL 9.
YOU’LL NOTICE THERE’S A LAG BETWEEN THE DELIVERY OF THE
PAPER QUESTIONNAIRES AND UPTICK IN PAPER RESPONSE.
BY THE TIME FOLLOW-UP BEGAN THE MAJORITY OF PAPER RESPONSES HAD
BEEN RECEIVED AND PROCESSES. RESPONSES ERROR SHOWN IN THE
YELLOW LINE. ONE THING WE FOUND INTERESTING
WAS THE UP TICK IN SELF-RESPONSE AFTER NON-RESPONSE FOLLOW-UP.
IT SEEMS TO INDICATE NOTICE FORMS AT THE DOORS OF HOUSING
THAT HAVE NOT YET RESPONDED PROMPTED ADDITIONAL RESPONSE.
WE PICKED UP AN ADDITION 24,000 SELF-RESPONSES.
IT WAS 12,000 BY THE INTERNET AND 3500 BY PHONE AND 9,000 BY
PAPER. THE SIGNIFICANT PIECE IS BY
PHONE. THAT WAS 31.4% OF ALL PHONE
RESPONSES CAME IN DURING THE NON-RESPONSE FOLLOW-UP PERIOD. THE CALL CENTERS WERE ACTIVE
FROM MARCH 16 THROUGH JULY 31. DURING THAT TIME WE HAD AN
INBOUND CALL VOLUME OF 26,000 CALLS.
IN THE LOWER TABLE YOU CAN SEE A LITTLE OVER 19,000 WENT TO A
LIVE CQA AGENT WHICH WAS SLIGHTLY LESS THAN EXPECTED AND
TURNED THEM INTO RESPONSES. ABOUT 11,000 CALLED RESULTED IN
A COMPLETED PHONE RESPONSE. THE TOTAL CALL VOLUME BY
LANGUAGE PIE CHART AND ASSOCIATED SUBTABLE AT THE TOP
SHOWS THE DISTRIBUTION OF CALLS BY LANGUAGE.
WHILE THE MAJORITY OF CALLS WERE IN ENGLISH AND SPANISH WE TOOK
CALLS IN EVERY CQA SUPPORTED LANGUAGE DURING THE TEST.
ONE EXCITING DEVELOPMENT FOR THE 2018 END-TO-END COUNCIL TEST WAS
THE EXPANDED — CENSUS TEST WAS THE EXPANDED WORK WITH THE
POSTAL SERVICE IN KIOSKS AND E-MAILS.
WE INSTALLED SELF-RESPONSE KIOSKS AND PEOPLE
WERE ABLE TO ACCESS THEM FOR THE 2018 TEST AND COMPLETE THE
QUESTIONNAIRE ONLINE AT THE POST YOU CAN SEE WE RECEIVED 111
RESPONSES VIA THE KIOSK AND LEVERAGED THEIR SUBSCRIPTION
SERVICE TO PROVIDE EASY ACCESS TO THE INTERNET SELF-RESPONSE
INTERNET. THE SERVICE THAT ENABLES USERS
TO REGISTER THEIR ADDRESS AFTER VALIDATING THEIR IDENTITY, ONCE
SUBSCRIBED, USERS CONTAINED A SCANNED IMAGE OF EACH LETTER OR
MAIL PIECE HEADING FOR THE MAILBOX.
THE DIGITAL PREVIEW INCLUDED A RIDE ALONG IMAGE AND EMBEDDED
LINK THAT CONNECTED SUBSCRIBERS TO THE END-TO-END CENSUS TEST
ONLINE QUESTIONNAIRE. THERE ARE OVER 13,000 SUBSCRIBERS AND THERE WERE
ACCOUNTS INITIATED BY THE E-MAILS AND RESULTS IN 34 ISR
RESPONSE AND RAISED AWARENESS ABOUT THE TEST AMONG SUBSCRIBERS AND WE’RE
DETERMINING THE NEXT STEPS IN THIS ARENA.
NOW THAT THE TEST IS LARGELY CONCLUDE FORD THE KEY
SELF-RESPONSE OPERATION WE’LL FINALIZE THE OPERATION FOR THE
2020 CENSUS. WE CAN ADD LANGUAGE TO THE
SELF-RESPONSE INTERNET AND ENGLISH, LANGUAGE, VIETNAMESE,
KOREAN, RUSSIAN, ASIA BICK, POLISH, FRENCH, ASIAN, CREOLE,
JAPANESE. AND WE’RE EXPANDING OUR REQUIRED
LANGUAGE SUPPORT TO 13 TOTAL LANGUAGES AND DETERMINING THE
LOCATIONS OF THE COMMERCIAL CONTACT CENTER FACILITIES TO
PAPER DATA CAPTURE OPERATION WILL BE FOR DATA CAPTURE CENTERS
ONE IN THE EAST NEAR THE JEFFERSONVILLE AND ONE IN THE
WEST IN PHOENIX, ARIZONA. AND FOR THE DISTRIBUTION
OPERATION AS AL MENTIONED EARLIER, WE’LL WORK WITH A NEW
PRINT VENDOR TO EXECUTE THE REQUIREMENTS OF THE 2020 CENSUS
AND SECURELY TRANSFERRING ADDRESS FILES AND LEVERAGING
AUTOMATION WHERE FEASIBLE TO PROVIDE MORE TIMELY INFORMATION
FLOW BACK TO HEADQUARTERS AS THE OPERATION TAKING PLACE.
AND THAT CONCLUDES THE SELF-RESPONSE PORTION OF OUR
2020 CENSUS PORTION. DOES ANYONE HAVE ANY QUESTIONS?
>>THANK YOU FORE — FOR THE UPDATE.
A COUPLE QUESTIONS. YOU HAVE THE 2020 PROJECTIONS
NOR RESPONSE RATE. ARE THOSE REFLECTING THE LESSONS
LEARNED ALREADY FROM THE 2018 TESTS?
HAVE THEY BEEN UPDATED YET OR FROM THE LAST ROUND?
>>THEY HAVE NOT BEEN UPDATED SINCE THE MAJORITY OF THE TESTS
ENDED RECENTLY.>>OKAY. GREAT.
I’M LOOKING AT THE AVERAGE HANDLE TIME I DON’T KNOW WHAT
THE MAP IS LIKE 12% OR SOMETHING LIKE THAT INCREASE.
GIVEN YOU HAVE A LOWER DEFLECTION RATE ONE WOULD EXPECT
THAT TO CORRELATE WITH LONGER CALLS.
DO YOU HAVE ANYTHING OBSERVED, ANYTHING KNOWN, ANY PRELIMINARY
S? LIKE WHAT WAS GOING ON WITH
THOSE?>>I’LL PASS THIS TO SHEILA.
>>I THOUGHT YOU MIGHT.
THE AVERAGE HANDLING TIME’S A LITTLE BIT LONGER THAN WE
ANTICIPATE AND LARGELY DUE TO THE FACT THAT THERE’S AN
INCREASE IN ENUMERATION. WE WERE DOING MORE ENUMERATIONS
THAN WE ORIGINALLY PROJECTED WE WOULD DO AND WOULD TAKE LONGER
TO ENUMERATE THAN ANSWER QUESTIONS.
JUST CURIOUS, FOR 2020 DO YOU EXPECT THE PARTNERSHIP EFFORTS
TO HAVE FURTHER RESPONSE OPTIONS OR IS IT ABOUT GETTING
OPERATIONS OUT THERE?>>WE’RE ASKING — THIS IS AL.
WE’RE ASKING OUR PARTNERSHIP PEOPLE TO FOCUS ON THE INTERNET
OF SELF-RESPONSE. THAT’S OUR FIRST AND MOST
EFFICIENT AND LOWEST-COST RESPONSE MODE AND THE EASIEST
RESPONSE MODE FOR PEOPLE TO RESPOND TO.
THAT’S THE FOCUS AND THEY SHOW PEOPLE HOW EASY TO RESPOND
DIRECTLY ONLINE. THEY’LL BE WORKING WITH
COMMUNITY ORGANIZATIONS WHO MAY HAVE RESPONSE PARTIES WHERE
PEOPLE COME WITH iPADS AND CAN SIT DOWN AND RESPOND.
IT’S OU LOWEST COST MODE.>>IF I COULD ADD TO THAT.
I’M BURTON REIST CHIEF OF DECENNIAL COMMUNICATION AND
STAKEHOLDER RELATIONS. THE PARTNERSHIP PROGRAM GIVES A
LOT OF OPPORTUNITIES TO REALLY TAILOR AND HAVE THEM TAILOR WHAT
THEY’RE ASKING COMMUNITIES TO DO AND HOW THEY’RE REACHING AND
SUPPORTING COMMUNITIES. THE LANGUAGE PROGRAM COMES INTO
BIG PLAY HERE SO PARTNERS IN A PARTICULAR COMMUNITY CAN DIRECT
PEOPLE TO THE 12 LANGUAGES WE’RE MAKING RESPOND OPTIONS AVAILABLE
TO VIA THE INTERNET FIRST ALWAYS AND ALSO OVER THE TELEPHONE AND
SUPPLYING SUPPORT MATERIALS IN 59 LANGUAGES AND EVEN TAILORING
MATERIALS WE PROVIDE THEM TO COMMUNITIES THAT SPEAK SPECIFIC
LANGUAGES WE DON’T ACTUALLY SUPPORT.
THAT’S ONE WAY. THAT’S AN IMPORTANT QUESTION
YOU’RE ASKING. IT’S IN THE PARTNERSHIP PROGRAM
WE TAILOR SUPPORT AND MESSAGING AND HAVE PARTNERS TAILOR SUPPORT
AND MESSAGING TO THOSE COMMUNITIES TO MAKE THEM RESPOND
AS QUICKLY AS POSSIBLE.>>THANK YOU, BURTON.
>>OKAY. DON’T SEE ANY MORE QUESTIONS BUT
WE’LL HAVE TIME FOR QUESTIONS THROUGHOUT THE SESSION SO WHAT
HAPPENS WHEN PEOPLE DON’T SEND ALEXA THEIR RESPONSE, THEN WE
KNOCK ON JENNIFER’S DOOR AND JENNIFER REICHERT WILL TELL US
HOW THINGS WENT WITH NON-RESPONSE FOLLOW-UP DURING
THE TEST.>>HERE’S AN EVERY VIEW OF WHAT
I’M GOING COVER. WE’LL TALK ABOUT WHAT THE
OBJECTIVES WERE FOR NURSES IN 2018 AND WHAT WENT INTO IT AND
EVERYBODY KNOWS ABOUT THE NON-RESPONDNON-RESPONDENTS AND
SOME SUCCESSES WE WERE ABLE TO OBSERVE IN 2018.
ONE WAS THE USE OF ADMINISTRATIVE RECORDS SO WE GOT
RESPONSE AND WE’LL COVER HOW WE GO FROM ’18 TO 2020 AND THINGS
WE KNOW WE NEED TO DO MOVING FORWARD.
I THINK EVERYONE IS FAMILIAR WITH THE OBJECTIVES FOR 2018.
FOR US WE HAD AREAS TO FOCUS ON. ONE WAS THE AUD MATION.
THERE WAS A LOT OF AUTOMATION WITH THE HIRING AND ENUMERATION
AND GETTING PEOPLE PAID. THAT WAS TESTED SUCCESSFULLY WE
TEST THE MOJO OPTIMIZER TO MAKING SURE THE FIELD WORK WAS
AS EFFICIENT IN GETTING IT OUT TO THE ENUMERATORS RECORD AND
REDUCING THE WORK LOAD IN THE VACANT AND DELETE PAYMENTS AND
HOUSING UNITS. WE’LL TALK ABOUT ALL OF THAT.
THIS SLIDE I SHOWED AT THE LAST P.M.R.
IT’S A GOOD ILLUSTRATION OF ALL THE WORK THAT COMES IN AND OUT.
IT’S A GREAT SUCCESS. SOME OF THE ACTUAL NUMBERS YOU
SEE 147,000 NON-RESPONDING UNITS THAT DID NOT SELF-RESPOND AND
THINGS CAME IN AND OUT THROUGHOUT THE PROCESS.
ONE OF THE THINGS I WANTED TO POINT OUT RATHER THAN WALKING
THROUGH EVERY ONE OF THE ARROWS IS TALK ABOUT THE CHART THAT
THIS ILLUSTRATES IS THIS SHOWS ONE CHART REPLACES FIVE
DIFFERENT PAPER OPERATIONS FROM 2010.
WE HAD NRFU AND THE FIELD VERIFICATION ALL PAPER ALL
MANAGED SEPARATELY NOW ALL PART OF ONE AUTOMATED OPERATION.
THAT’S A HUGE STEP FORWARD. SO HOW DO WE DO IT?
IT’S OUR MANAGEMENT REPORT FOR NRFU WE USED THIS THROUGHOUT THE
OPERATION TO SHOW HOW HE WAS DOING AND THE TOP IS THE
PROGRESS AS WE CAN SEE FROM THE BEGINNING OF THE OPERATION WE
TRACKED SADLY IN TERMS OF PROGRESS TOWARDS THE END AND YOU’LL SEE WEIRD
FLUCTUATIONS AND THAT IS THE TIME WE SPENT IN THE TIME AND
HONING OUR CLOSEOUT AND FINAL ATTEMPT AND REOPENED CASES
PREVIOUSLY CLOSED. IT MADE IT LOOK LIKE WE LOST
PROGRESS BUT IT WAS AN ARTIFACT OF THE EFFORTS AT THE END.
THE BOTTOM SHOWS THE COST. WE STARTED BELOW BUDGET AND
STAYED BELOW BUDGET FOR THE OPERATION SO THAT WAS GOOD.
I WANT TO POINT TO THE LOWER LEFT HAND CORNER SHOWING THE
NUMBER OF SELF-RESPONSE FROM THE NRFU UNIVERSE.
OVER 14,000 OF OUR NRFU HOUSEHOLDS RESPONDED.
THAT’S 10% OF THE NON-RESPONDING UNIVERSE.
THAT’S A GREAT INDICATOR THE NOTICES OF VISITS AND HAVING
NUMERATORS OUT THERE KNOCKING ON DOORS ENCOURAGED HOUSEHOLDS TO
RESPOND ON THE ISR OR PAPER QUESTIONNAIRE.
THAT’S A HUGE BOOST IN REDUCING COSTS AND WORK LOAD.
SO SUCCESSES. HAVING BEEN THROUGH 2010 I WANT
TO WALK THROUGH THE SUCCESSES. I WANT TO REMIND EVERYBODY WHAT
THIS LOOKED LIKE. WE HAD NUMERATORS WALKING AROUND
HANDLING REEMS OF PAPER AND BINDERS AND REPORTING TIME AND
ATTENDANCE AND CASE LIST AND MATERIALS THEY USED TO TALK TO
THE RESPOND ENTS WHETHER IT’S A LANGUAGE CARD OR OTHER
MATERIALS. THEY HAD TO MEET WITH CREW
LEADERS EVERY DAY IN FACE TO FACE MEETINGS IN ORDER TO HAND
OFF THE QUESTIONNAIRES AND TIME AND ATTENDANCE SHEETS.
THE ENUMERATORS HAD TO MAKE MULTIPLE VISITS TO EMPTY LOTS
AND VACANT HOUSING UNITS AND VERIFYING A LOT OF WAS EMPTY OR
A HOUSING UNIT WAS VACANT. THAT WAS A LOT OF EFFORT PUT OUT
IN THE FIELD TO DO THAT. HOW DID THAT CHANGE?
NOW WE HAVE THE iPHONES, THE ENUMERATORS ARE DOING EVERYTHING
AND TURNING IN THEIR PAYROLL AND DOING THEIR ENUMERATION, THEY’RE
TALKING TO SUPERVISORS AND TEXTING AND MAKING PHONE CALLS
AND NOT HAVING TO DO ALL THE MANUAL TRANSPORT OF PAPER AND
MEETING WITH CREW LEADERS EVERY DAY.
THAT’S A HUGE STEP FORWARD. THE PAYROLL WAS BIG.
WE DIDN’T HAVE HUNDREDS OF CLERKS AND OFFICES KEYING IN
PAYROLL EVERY DAY 24/7. THAT WAS A HUGE SAVINGS.
THE ENUMERATORS GOT THEIR TASKS AND I REMEMBER MEETING WITH THEM
AT McDONALDS WITH THEIR MAP AND LIST OF CASES FIGURING OUT HOW
TO DO THEIR WORK. THEY DON’T HAVE TO AERN — ANY MORE.
THE OPTIMIZER DOES THAT FOR THEM AND THE ENUMERATORS DON’T HAVE
TO WALK AROUND AND WAIT FOR A VACANT LOT TO BE CONFIRMED A
VACANT LOT. SO HUGE SUCCESSES IN TERMS OF
AUTOMATION AND MAKING IT MORE EFFICIENT.
ON THE TOPIC OF ADMINISTRATIVE RECORDS.
AGAIN, A HUGE SUCCESS IN 2018. AND TO REMIND EVERYBODY OF OUR
STRATEGY FOR VACANT AND DELETE HOUSE UNITS THE STRATEGY WAS TO
PULL THEM OUT OF THE WORK LOAD AND MAIL A POST CARD.
WE GET REPORTS BACK FROM THE POSTAL SERVICE WHETHER THEY’RE
ABLE TO DELIVER IT. IF THEY CAN’T GET GET A RESPONSE
OF A UAA AND THEN THE CASE IS COMPLETE.
WE DON’T HAVE TO TRY THEM IN THE FIELD.
IF WE DON’T GET A UAA THEY CAN GO BACK TO MAKE
SURE WE’RE NOT MISSING ANYBODY IN THE UNITS.
IN 2018 WE REMOVED ABOUT 11,000 CASES PRIOR TO THE START OF
NRFU. YOU SEE THE SPLIT.
MOST VACANT HOUSING UNITS AND DELETED ONES AS WELL WAITING FOR
THE RETURN FROM THE POST OFFICE WE PUT 3500 CASES BACK TO NRFU
SO THAT PROCESS WORKED SUCCESSFULLY.
OR OCCUPIED UNITS WE MODELLED THEM AT THE START TO SEE IF WE
HAVE GOOD HIGH QUALITY RECORDS DATA FROM SOURCES LIKE IRS AND
WE CONSOLIDATE THE FEDERAL RECORDS.
IF WE HAVE GOOD HIGH-QUALITY DATA FOR A HOUSEHOLD WE’LL MAKE
ONE ATTEMPT TO KNOCK ON THE DOOR AND TRY TO DO AN INTERVIEW.
IF WE CAN’T MAKE CONTACT WITH THE HOUSEHOLD WE’LL USE THE
RECORDS DATA TO ENUMERATE THE HOUSEHOLD AND THEN DON’T HAVE TO
MAKE THE EXPENSIVE VISIT. WE DID THIS IN 2018.
WE HAD OVER 200,000 HOUSEHOLDS AS ENUMERATION HOUSEHOLDS.
MOST AT THE BEGINNING OF NRFU WHEN WE GOT THE FIRST DELIVERY
OF TAX DATA IN MAY WE WERE ABLE TO PULL MOST THE CASES.
WE PULLED IT AGAIN IN JUNE AND WERE ABLE TO PULL OUT ANOTHER
680 HOUSING UNITS OUT OF NRFU. THE 680 OBVIOUSLY WERE IN NRFU
FOR A MONTH SO SOME MAY HAVE RECEIVED MORE THAN ONE VISIT BUT
THEN WE COULD PULL THEM OUT OF THE WORK LOAD.
NOW WE’RE DOWN WITH ’18. WE HAVE TO MOVE FORWARD.
AS WITH ANY TEST WE HAD ISSUES AND CHALLENGES IN ’18 WE KNOW WE
NEED TO ADDRESS. EARLY ON IN THE OPERATION, THE
AUTOMATED TRAINING PROCESS WE HAD SOME CHALLENGES CLEARING
ENUMERATORS OUT OF THE TRAINING PHASE TO PRODUCTION.
THERE WERE ISSUES IN THE SOFTWARE ABOUT RECORDING THE
ASSESSMENT SCORES. THAT ISSUE IS FIXED BUT WE HAD
TO IMPLEMENT WORK AROUNDS AND NEEDED TO MAKE SURE THINGS LIKE
THAT DON’T HAPPEN. THE iPHONES THEMSELVES ARE GREAT
FOOLZ TOOLS FOR AUTOMATION. WE HEARD FROM SOME ENUMERATORS
THEY HAD SOME DIFFICULTY IN GETTING IT TO RECOGNIZE THEIR FINGER TOUCHES.
WE LEARNED MAYBE WE NEED TO GIVE THEM STYLE USES TO HELP THEM
INTERACT WITH THE DEVICE. WE GAVE NOTICES OF VISITS TO
WHICH WAS GREAT TO GETTING PEOPLE TO SELF-RESPOND BUT THE
ENUMERATOR HAD TO WRITE THE CASE AND AS THEY STAND ON THE FRONT
PORCHES THEY WERE LOOKING FOR HARD SURFACES TO RIGHT THIS DOWN
BECAUSE THEY HAD A LOOSE STACK. STUPID LITTLE THINGS LIKE THAT
BUT IT HAS AN IMPACT WITH HUNDREDS PEOPLE ON THE STREET SO
WE KNOW WE HAVE TO GIVE THEM A CLIPBOARD OR A HARD BACKING.
THE PROXY PATH. THEY’RE AN IMPORTANT PART OF
NON-RESPONSE FOLLOW-UP. WE HAD ISSUES WITH THE PROXY
PATH. THERE WAS A BUG EARLY ON WHERE
IT FORCED ENUMERATORS REPEATED ATTEMPTS WHEN THEY DIDN’T NEED
TO AND THE BUG WAS FIXED AND IT IMPACTED THE ENUMERATORS.
WE GOT SOME FEEDBACK THE PROXY PATH IS BURDENSOME FOR THE
ENUMERATOR AND RESPONDENT. SOMETIMES THEY DON’T KNOW ALL
THE DETAILS OF EVERYBODY NEXT DOOR.
THEY MAY KNOW THERE’S FIVE PEOPLE BUT DON’T KNOW THEIR
BIRTH DATES OR AGES AND THEY WERE FORCED TO GO THROUGH EVERY
ELEMENT AND ENTER IN DON’T KNOW OR REFUSED.
IT TOOK TIME AND A BURDEN FOR THE RESPONDENT AND ENUMERATOR
AND WANT TO STREAMLINE THE PROCESS FOR PROXIES AND
ENUMERATORS. LAST IS ALERTS.
THEY’RE MEANT TO BE TOOLS NOR — FOR MANAGERS AND A HANDFUL OF
ALERTS THERE WERE ISSUES WITH FALSE ALERTS AND DREW INTO
QUESTION ALL ALERTS. AS A WHOLE THE ALERTS WEREN’T AS
EFFECTIVE AS WE’D HOPED. MOVING FORWARD WE HAVE TO HAVE
THEM USEFUL TO THE MANAGER. THEY NEED TO BE ABLE TO USE THE
ALAERTSALAERTS — ALERTS TO MANAGE EMPLOYEES AND THEIR WORK.
IN ADDITION TO CHALLENGE AND ISSUES THERE’S THINGS WE NEED TO
DO FOR 2020 ENHANCEMENT AND THE ABILITY TO
SEE THE STATUS OF ALL THE ADDRESSES IN THEIR AREA.
IT HELPS THEM UNDERSTAND WHAT’S GOING ON IN THEIR AREA.
MAPPING APPLICATION. WE KNOW WE HAVE TO GIVE THE
ENUMERATORS A MAP TO SEE WHERE EVERYTHING IS.
INFIELD ADS. THEY’LL FIND BASEMENT APARTMENT
AND NEW DEVELOPMENTS AND THEY HAVE TO HAVE THE ABILITY TO GET
THOSE PEOPLE ENUMERATED. AND THERE’S AN AREA THAT IS
DANGEROUS AND WE NEED TO MAKE SURE THEY CAN KEEP THE
ENUMERATOR SAFE AND WILL IMPLEMENT THAT CAPABILITY ACROSS
THE COUNTRY. WORK AVAILABLE TY WE WANT TO GET THEM TO WORK
MAYBE TWO HOURS IN THE MORNING OR AFTERNOON, LET THEM TELL US
THAT SO WE CAN GIVE THEM WORK IN THE MORNING AND AFTERNOON.
MAKE THE MOST USE WE CAN OF THE AVAILABILITY.
STOPPING AND RESTARTING. WE ALWAYS HAVE TO DO THIS
WHETHER THERE’S A NATURAL DISASTER SO WE HAVE TO BUILT
THAT CAPABILITY. MANAGER VISIT CASES.
THIS IS WHERE WE TALK TO MANAGERS AND WANT TO MAKE THE
PROCESS MORE EFFICIENT TO MAKE THE CASES AVAILABLE IMMEDIATELY
IF APPROPRIATE. IF IT’S ON THE EVENING, ON A
WEEKEND, WE WANT ENUMERATORS TO GO RIGHT AWAY AND KNOCK ON DOORS
WHEN PEOPLE ARE HOME. WE WANT TO MAKE THAT MORE
EFFICIENT. WE’LL WORK ON OUR REPORTS.
THAT’S ALWAYS TO MAKE SURE THE MANAGERS HAVE THE INFORMATION
THEY NED TO KNOW WHAT’S GOING ON.
WE HAVE TO FINISH ADAPTING EVERYTHING FOR PUERTO RICO.
WE HAVE TO MAKE SURE EVERYTHING IS READY FOR THE PUERTO RICO
ADDRESSES. AND THE LAST TWO BULLETS ARE
THINGS COMING NOT IN ’18. EARLY NRFU WE KNOW WE’LL DO IN
2020 AND WE GO OUT TO THE COLLEGES AND GET THERE EARLY
BEFORE STUDENTS LEAVE THE ON-CAMPUS HOUSING AND ADDITIONAL
WORK LOADS THAT CAN’T — DIDN’T COME INTO PLAY IN 2018 AND NEW
CONSTRUCTION. IT’S NOT A NEW FUNCTIONALITY BUT
WANT TO BE READY AND PLANNING FOR THOSE ADDITIONAL CASES THAT
WILL COME IN. I THINK THAT IS OUR LIST.>>THANKS.
ALWAYS FUN TO HEAR THE UPDATES. CONGRATULATIONS ON THE COST
SAVINGS. WHAT’S IT SAY ABOUT THE COSTS
FOR 2020? DID WE LEARN SOMETHING BECAUSE
IT’S A GREAT ACHIEVEMENT. WONDERING IF THERE’S AN
EXPLANATION FOR THE DELTA.>>THE DELTA AND COST SAVING
THERE’S A LOT OF FACTORS THERE. WE DIDN’T HAVE AS MANY STAFF AS PLANNED AND SELF-RESPONSE WAS
HIGHER AND WE’RE TAKING THE LESSONS FROM ’18 AND TRY TO
REFLECT THEM.>>AND I NOTE THERE WAS A
SIGNIFICANT PERCENTAGE HIGHER THAN 2010, CONGRATULATIONS, DO
WE KNOW HOW THEY COMPARED TO HOW YOU’RE THINKING FROM 2020.
I DON’T REMEMBER FROM THE EARLIER CONVERSATION IS 12% WHAT YOU’RE PROJECTING FOR 2020?
>>THINK IT’S CLOSE TO WHAT WE WERE PROJECTING.
>>TOM WITH DFD. THE 2018 TEST HAS A LOWER
SELF-RESPONSE RATE SO THERE’S A LOWER PERCENTAGE OF CASE TO
APPLY TO 2018 THAT MAY NOT RETROSPECTIVELY APPLY TO 2010 OR
MAY APPLY AGAIN IN 2020.
IF THEY HAVE MORE CASES OR RECORDS WE’RE TRYING TO ASSESS
TO EXPLAIN THE HIGHER PERCENTAGE THAN WE SAW IN 2018.
>>GOOD POINT. THANKS, TOX.
— TOM. THE DYNAMIC NATURE OF WHO IS
RESPONDING AND WHO YOU CAN PULL OUT.
I KNOW YOU’LL BE TALKING ABOUT WHAT YOU LEARN FROM THE 2018
TEST, BUT AT THIS POINT IS IT TOO EARLY TO COMMENT ON I THINK
YOU TALKED ABOUT MEETING YOUR GOAL OF WHAT YOUR TEST WAS FOR
BUT WHEN YOU MOVE FROM 2020 FROM THE TEST AND WHAT YOU LEARNED
AND DEMONSTRATED WITH IT, IS IT TOO EARLY TO TALK ABOUT HOW
YOU’RE GOING TO TEST SOME OF THE MANY THINGS YOU HAVE GOT ON YOUR
LIST THAT LOOK LIKE IT’S NOT JUST A SYSTEM ISSUE OR PEOPLE
ISSUE, IT’S A SYSTEM AND PEOPLE ISSUE.
I’M FLIRCHK HERE ON OUT TO 2020 IS THERE MORE SPACE FOR ANY
ADDITIONAL PEOPLE AND SYSTEM TESTING?
I NOTICED LOOKING AT THE LIST IT’S WHERE TECHNOLOGY MEETS
PEOPLE AND I THINK YOU GOT WHAT YOU NEEDED TO MOVE FORWARD BUT
IS THERE ROOM OR SPACE YET FOR MORE TESTING FROM HERE ON OUT IN
ANY WAY?>>WE’LL HAVE SMALL LOCAL TESTS.
WE MAY DO SOME OUT OF HEADQUARTERS OR OTHER REGIONAL
OFFICES TO ENABLE TO US TEST SOME OF THOSE INTERACTIONS
BETWEEN THE PEOPLE AND SYSTEMS ON A MORE FOCUSSED SMALL LEVEL.
THERE WILL NOT BE A LARGE-SCALE TEST IN 2019 BUT WE’LL TEST
SPECIFIC FUNCTIONALITY AND/OR MANAGEMENT TESTS IN THE CURRENT
FIELD INFRASTRUCTURE WE HAVE.>>YOU HAVE THE SCHEDULE BUILT
IN FOR THAT KIND OF THING AND THE OPPORTUNITY TO TURN THAT
AROUND? WE LOOKED AT THE SCHEDULE AND
TRYING TO FIGURE OUT WHERE SOME STUFF FITS IN.
>>AS WE LAY OUT WHAT THEY ARE IT DEPENDS ON THE ELEMENTS.
SOME ELEMENTS WE HAVE TO DEFINE WHAT WE NEED TO DO FROM THE
ASSESSMENT OF THE TEST RESULT AND TEN DETERMINE WHERE THAT
FITS IN OUR DEVELOPMENT SCHEDULE TO STAY ON TRACK.
IN SOME CASES THERE IS TIME SLACK TO ENABLE THAT AND OTHER
PARTS THE SCHEDULE IS TIGHT AND WON’T ENABLE US.
>>THANK YOU.>>CAROL RAY, OIG.
IF I RECALL, THE FIRST TIME YOU TESTED THIS WAS IN THIS TEST.
YOU HAD NO FEEDBACK. I’M WONDERING, DID YOU LEARN HOW
IT WENT?>>FOR THE TEST WE HAD
RE-INTERVIEW FOR THE SAMPLE SELECTION CYCLING THROUGH CQA
FIRST IF WE HAD A PHONE NUMBER AND RECYCLED BACK TO THE FIELD.
THAT WAS SUCCESSFULLY IMPLEMENTED.
WHAT WE DIDN’T GET DONE WAS THE CLERICAL RESOLUTION AND WE’LL
WORK WITH THE SYSTEM IN DOING A CLERICAL RESOLUTION BUT THE
COMPONENT WERE SUCCESSFULLY [INDISCERNIBLE]
.>>MORE QUESTIONS FOR JENNIFER?
OKAY, BRINGING US HOME TO THE BREAK WE STILL HAVE PART OF OUR
2018 TEST STILL IN THE FIELD AND JUDY BELTON IS HERE TO INTRODUCE
US TO GROUP QUARTERS AND GIVE AN UPDATE ON WHERE WE ARE IN THE
MOMENT.>>LET’S TALK GX.
I WANT TO GIVE A SPECIAL SHOUT OUT TO THE GQ IPT MEMBERS.
WE JUST GOT STARTED AND HAVE A LONG WAY TO GO BUT THEY’RE DOING A GREAT JOB.
FOR THOSE WHO ARE ALL FAMILIAR WITH GROUP QUARTERS, THE
OBJECTIVE OF THE OPERATION IS TO GIVE YOU UPDATES ON HOW THE TEST
HAS BEEN GOING SO FAR.
THE GROUP QUARTERS IS WHERE THEY’RE MANAGED BY AN ENTITY OR
ORGANIZATION PROVIDING HOUSING AND/OR SERVICES FOR THE
RESIDENT. IT’S NOT A TYPICAL LIVING
SITUATION AND PEOPLE LIVING IN GROUP QUARTERS ARE NOT TYPICALLY
RELATE. WE HAVE THE CORRECTIONAL
FACILITIES FOR ADULTS AND A FEDERAL FACILITY LIKE THE BUREAU
OF PRISONS AND STATE PRISONS AND SOME LOCAL JAILS AND KREKT —
CORRECTIONAL FACILITIES AND BOOT CAMPS AND FACILITIES AND THERE’S
A NURSING HOPE AND THESE ARE ALSO PLACES WITHIN A FACILITY
THEY HAVE SEVEN DAYS, 24-HOUR SKILLED CARE.
THAT’S THE SKILLED WORD COMES FROM.
SO WE KNOW WHAT ABOUT THE HOUSING FACILITIES AND GROUP
HOMES FOR ADULTS, RESIDENTS AT TREATMENT CENTERS AND MILITARY
AND THE SERVICE SPACE LOCATION. THE EMERGENCY AND TRANSITIONAL
SHELTERS AND SOUP KITCHEN AND REGULARLY SCHEDULED MOBILE FOOD
VANS AND TARGETED NON-SHELTER OUTDOOR LOCATIONS.
YOU CAN SEE WHEN YOU LOOK AT THE TEST, GROUP QUARTERS SAY — IS A
COMPLEX OPERATION. WE’RE AT THE MERCY OF THE
FACILITY ADMINISTRATOR WE CALL HIM THE GATE KEEPER.
THEY HAVE PRIVACY AND SECURITY CONCERNS WE HAVE TO DEAL WITH.
IN GROUP QUARTERS DATA COLLECTION WE TRY TO OFFER
ENUMERATION METHODS TO MAKE IT COMFORTABLE FOR THE
ADMINISTRATOR TO PARTICIPATE IN THE CENSUS.
SOMETIMES THEY SAY NO AND WE HAVE PUT ON OUR SALESMAN HAT TO
GET THEM DO DO SO. WE WANT TO GIVE THEM OPTIONS
THEY’RE COMFORTABLE WITH AND MAKE SURE THE OPTIONS WE’RE
PROVIDING GIVE US QUALITY DATA.
SO GROUP QUARTER DATA COLLECTION, THERE’S ADVANCED
CONTACT AND ENUMERATION. THE OBJECTIVES ARE TO REDUCE
RESPOND TO BURDEN BY LIMITING THE NUMBER OF BUSINESSES WE MAKE
TO THE GROUP QUARTERS THIS IS WHERE ADVANCED CONTACT OPERATION
COMES INTO PLAY WHERE CLERKS AND ACOs WILL MAKE A PHONE CALL TO
THE GROUP QUARTERS TO LET THEM KNOW WE’RE
COMING AND WHAT WE DID THIS TIME BEFORE THE OPERATION HAPPENED WE
SENT INTRODUCTORY LETTERS OUT TO THE LOCATIONS LETTING THEM KNOW
WE WERE COMING. THERE WAS A LINK IN THE LETTER
WHERE THEY CAN GO TO OUR WEBSITE AND MAKE IT MORE ABOUT GROUP
QUARTERS AND LEARN ABOUT THE METHOD WE WERE OFFERING AND KNOW
IN ADVANCE OF THE PHONE CALL.
THEN ANOTHER OBJECTIVE IS FACILITY-PROVIDED RECORD IN
ELECTRONIC AND PAPER FORMAT. FOR 2018 AND 2020, WE’RE
INTRODUCING THE ELECTRONIC DATA RESPONSE AN E-RESPONSE OPTION.
I’LL GET INTO THAT MORE. THIS IS A GOOD OPTION FOR
ADMINISTRATORS WHO REALLY DON’T WANT TO BE BOTHERED AND ARE
CONCERNED ABOUT THE PRIVACY AND WANT TO UPLOAD THE DATA TO A SECURE SERVER.
WE’RE MORE THAN TWO-THIRDS TESTING THIS IN 2018.
WE CONDUCTED CONTACT THROUGH JULY 10 AND CONDUCTED SPACE
ENUMERATION THE 25th THROUGH THE 27ING AND — 27th AND JUST
STARTED ENUMERATION ON MONDAY. WE’RE JUST GETTING GOING. WE HAVE THE SERVICE-BASED
LOCATIONS, JUVENILE FACILITIES, NURSING FACILITIES AND A GOOD
NUMBER OF THE COLLEGE UNIVERSITY STUDENT HOUSING, RELIGIOUS GROUP
QUARTERS AND GROUP HOMES AND RESIDENTIAL TREATMENT CENTERS.
OUR INITIAL WORK LOAD WAS ABOUT 569 GROUP QUARTERS BUT WE SAW
WHAT WE WERE LACKING WITH THE SERVICE-BASED ENUMERATION AND
THROUGH THE SERVICE PROJECT WE ADDED ADDITIONAL SERVICE-BASED
OPERATIONS BECAUSE WE WANTED TO BE ABLE TO TEST THE POPULATION
IN THIS ’18 TEST.
WE HAVE AN IN-HOUSE SYSTEM FOR OTHER DECENNIAL PROGRAMS BUT
DESIGNED TO HELP US WITH GQ CONTACT.
THE CLERKS ENTER THE POPULATION TODAY, APRIL 1, THE PREFERRED
METHOD OF EPNEUM RAGE — ENUMERATION AND A DATE AND TIME
FOR THEM TO MAKE THE DATA COLLECTION.
SO WHAT ARE THE METHODS?
WE GIVE FIVE OPTIONS. THE FIRST IS AN ELECTRONIC
OPERATION AND THEN THE SCORE DATA PAPER COLLECTION OFFICE AND
EANYTIME RATION AND HERE’S WHERE THE CONTACT PERSON BECOMES AN TRAINED AND GIVEN ALL THE TOOLS
THEY KNEAD TO CONDUCT THE GROUP QUARTER DATA COLLECTION FOR
THEIR FACILITY. THEN DROP OFF AND PICK UP WHERE THE ENUMERATOR DROPS OFF THE FORMS.
THEN THERE’S IN-PERSON INTERVIEWS.
HERE’S WHERE THEY CONDUCT THE IN-PERSON INTERVIEW WITH EACH
RESIDENT TO COMPLETE THE INDIVIDUAL CENSUS QUESTIONNAIRES
AND PAPER LISTING WHERE THE FACILITY DOESN’T WANT TO BE
BOTHERED. JUST COME OUT AND I’LL GIVE YOU
A ROSTER OF EVERYBODY HERE ALONG WITH THE DEMOGRAPHIC ITEMS.
I’LL LET YOU KNOW NOT ALL THE OPTIONS ARE GIVEN TO EVERY GQ
TYPE. WE WOULDN’T OFFER DROP OFF/PICK
UP TO THE SOUP KITCHEN. WE DON’T OFFER THAT TO THEM.
FOR THE MOST PART MANY GQs GET A VARIETY OF OPTIONS AVAILABLE TO THEM.
OKAY, SO WE’RE DONE WIN ADDANCED CONTACT OPERATION.
HERE’S THE BREAKDOWN OF THE WORK LOADS.
THIS IS RAW DATA AND EVALUATION DONE IN THE FALL OF WHAT WE’VE
LEARNED AND WE’LL LOOK AT EVERYTHING COMING OUT OF THERE
THAT OPERATES SO THEREFORE THE INFORMATION I’M SHARING IS BASED
ON THE DAY TO DAY MONITORING OBSERVATIONS.
LET’S LOOK AT THE STATUS OF EVENT CONTACT CASES TO MY LEFT.
THERE ARE THREE CATEGORIES. THERE’S THE COMPLETED WITH
APPOINTMENT AND ENUMERATION METHOD AND OUT OF SCOPE AND
UNRESOLVED. THEY WERE ABLE TO MAKE CONTACT
WITH 283 OR 41% OF THE GQs DURING ADVANCE CONTACT.
THIS INCLUDED 60% OF THE COLLEGE AND STUDENT HOUSING, 37% OF THE
NURSING HOMES, 61% OF THE RELIGIOUS GROUP QUARTERS.
WE WERE ABLE TO MAKE CONTACT WITH THE EMERGENCY AND
TRANSITIONAL SHELTERS AND SOUP KITCHEN.
DOWN LOOKING AT THE OUT OF SCOPE, 187 OF THE GQs WERE OUT
OF SCOPE BECAUSE THEY WERE NON-RESIDENTIAL AND COULD HAVE
BEEN STORES, BUSINESSES, PLACES LIKE THAT.
OR THE GQ WAS CLOSED APRIL 1. DURING ADVANCED CONTACT THOUGH
WE TESTED LATER WE WERE ASKED WERE PEOPLE LIVING THERE APRIL
1. IF IT WAS NO, THEY WERE OUT OF
SCOPE OR WILL PEOPLE LIVE AT THE SERVICE SPACE LOCATION JULY 25
OR THROUGH THE 27th AND IF THEY SAID NO, THEY WERE OUT OF SCOPE.
MANY WERE SERVICE-BASED LOCATION.
WE DID HAVE SOME GROUP HOMES AND RESIDENTIAL TREATMENT CENTERS
AND NURSING FACILITIES I THINK ARE SUSPECT BUT THAT’S WHAT WE
FOUND DOING ADVANCED CONTACT. 29% WERE UNRESOLVED.
MEANING WE WEREN’T ABLE TO CONTACT THEM AT ALL.
THEY WERE REFUSALS. ONE THING TO NOTE ABOUT THE
CATEGORY, FOR ALL THE UNRESOLVED, WE WEREN’T ABLE TO
MAKE CONTACT DURING ADVANCED CONTACT, THEY ARE GOING FOT
FIELD FOR SERVICE-BASED ENUMERATION AND GQ ENUMERATION.
SO WE DIDN’T FORGET ABOUT THEM.
LOOKING AT THE ENUMERATION METHOD, THE PAPERLESS IS THE
METHOD MOST SELECTED BY THE ADMINISTRATE AND 152% FOLLOWED
BY E-RESPONSE WE HAD 52 ADMINISTRATORS THAT CHOSE THAT
AND DROP-OFF AND PICK-UP AND THAT GOES DOWN.
A VARIETY OF GQs SELECTED PAPER LISTING.
WE HAVE COLLEGES AND FACILITIES TO CHOOSE THAT.
I THINK THE LARGER NUMBER THAT CHOSE E-RESPONSE WERE THE GROUP
HOMES. STATE PRISONS CHOSE DROP-OFF,
PICK-UP AND HOPED THEY CHOSE THE E-RESPONSE BECAUSE WE TESTED
PRISONS A COUPLE YEARS AGO WITH THE E-RESPONSE AND THEY CHOSE
DROP-OFF, PICK-UP WHICH ISN’T A SURPRISE EITHER.
I HOPED THEY CHOSE E-RESPONSE BUT WE’RE WORK ON THAT.
IS THAT WHAT WE EXPECTED? I’D SAY YES.
LOOKING AT 2010, A PERCENTAGE GAVE US PAPER LISTINGS.
THEY SAID COME HERE, PICK IT UP AND GET OUT OF OUR HAIR.
WHAT WE’RE HOPING TO DO BETWEEN NOW AND 20 IS TO SHARE THE
INFORMATION — 2020 IS TO SHARE THE INFORMATION ABOUT THE
E-RESPONSE TO HAVE THEM COMFORTABLE UPLOADING THE FILES
ELECTRONICALLY. WE ALREADY HAVE A PARTNERSHIP
WITH THE BUREAU OF PRISONS AND U.S. MARSHALS AND WORKING ON A
PARTNERSHIP WITH OTHER ORGANIZATION TO GET OUT THE
MESSAGE IN THE E-RESPONSE METHOD.
WE JUST GOT TO THE GROUP QUARTERS COMPONENT.
LET’S LOOK AT WHAT HAPPENED FOR OUR SERVICE BASED ENUMERATION.
WE WERE ABLE TO DURING ADVANCE CONTACT CONFIRM OR GET
CONFIRMATIONS FROM 11 FACILITIES.
THOSE ARE SEVEN SHELTERS, THOSE SEVEN SHELTERS, FOUR CHOSE PAPER
LISTINGS AND THREE CHOSE IN-PERSON INTERVIEW.
WE WERE ABLE TO CONFIRM-INTERVIEW AND GO OUT TO
THREE SOUP KITCHENS, ALL IN PERSON.
THERE’S ONE TINSEL LOCATION, THESE ARE PLACES LIKE UNDER A
BRIDGE, BY A PARK BENCH. I WAS REALLY INTERESTED IN THIS
ONE THAT HAD AN ADDRESS AND WE WERE ABLE TO MAKE CONTACT WITH
AND ABLE TO GO OUT THERE BUT IT WAS A REFUFL.
— REFUSAL. WE NOTICED THERE WAS A GAP AND
NEEDED TO TEST THIS BETTER. THE PARTNERSHIP SPECIALIST AND
FIELD DIVISION DID RESEARCH AND FOUND 36 FOR US TO VISIT AND SO
WE WERE ABLE TO CONTACT THEM. LOOK AT THE OTHER SBEs, 11 WE
CONFIRMED, 4 TURNED OUT TO BE — 14 TURNED OUT TO BE
NON-INTERVIEWS. WITH THE TINSELS WE WERE ABLE
THROUGH OUR FIELD PARTNERSHIP SPECIALISTS, MAKE CONTACT, GO
OUT AND INTERVIEW 36 TINSELS FROM 36 SITES AND INTERVIEWED 32
PEOPLE. KUDOS TO THEM — THEY WERE
LIVING IN BRIDGES, OUT IN CEMETERIES.
FINDING PEOPLE OUT IN THE NON-SHELTERED LOCATIONS. THE OTHER GQ TYPES WE STARTED
INTERVIEWING JULY 30. WE HAD A WORK LOAD OF 400 GROUP
QUARTERS, TO AT MY LAST CHECK WERE ASSIGNED AN ENUMERATOR AND
SENT OUT LETTERS TO THE ADMINISTRATORS WHO WANTED TO DO
E-RESPONSE. THEY’RE AT THE DOOR AND WITHIN
THE LETTER, WE INSTRUCT THEM — IT’S A USER I.D. FOR THE CONTACT
PERSON AND FOR EACH OF THE G.I.s ASSOCIATED WITH THE ADMINISTRATOR.
EVERY GQ HAS AN I.D. ASSOCIATED WITH IT AND EXPECT A DIFFERENT
FILE FOR EACH. THE LETTERS OF INSTRUCTION HAVE GONE OUT.
WE DID RECEIVE ONE FILE YESTERDAY FROM THE MARSHAL
SERVICE FOR A GQ UNDER THEIR UMBRELLA.
SO WE’RE LOOKING FORWARD TO EVALUATING WHAT’S GOING ON WITH THAT.
I’LL TOUCH A LITTLE BIT ON THE 2019 UNRESOLVED CASES WE FOUND.
THEY WERE ABLE TO CONVERT 15 OF THE 20 219 CASES TO IN-PERSON
INTERVIEWS AND 17 TO DROP-OFF/PICK-UP AND ANOTHER TYPE.
THAT’S ALL I HAVE. QUESTIONS?
>>I APPRECIATE THE UPDATES. TWO QUICK QUESTIONS ON ADVANCED
CONTACT. FOR 2020 YOU’LL PROBABLY BE
DOING ADVANCED CONTRACT WITH ENUMERATION CLOSER TO APRIL 1.
DO YOU EXPECT THAT TO HAVE AN IMPACT ON THE ENUMERATION METHOD
FACILITIES CHOOSE? DOES IT BECOME MORE OR LESS
CONVENIENT CLOSER TO APRIL 1?>>FOR THE COLLEGE DORMS AND
UNIVERSITY HOUSES A LOT OF THEM CHOSE PAPER BECAUSE
[INDISCERNIBLE] I HOPE THEY REMIND THAT GOING
FORWARD FOR 2020 AND ALSO CHOOSE THE PAPERLESS THING OR DON’T
WANT US THERE BECAUSE SOME HAVE PRIVACY ISSUES WITH US ON SITE.
OTHER THAN THAT IT DOESN’T SEEM TO BE EFFECTIVE.
I DON’T THINK I HAD SURPRISES THERE.
>>GIVEN IT WAS THE FIRST TIME ADVANCED CONTACT WAS CONDUCTED
OUT OF THE OFFICE WHEN YOU EVALUATE THE EFFECTIVENESS OF
THAT IS PART HOW THE DISTRIBUTION OF ENUMERATION
METHODS STACKED UP WITH THE GROUND AND THE PREDICTOR OF WHAT
THE FACILITY IS LIKE? ARE YOU OKAY WHERE FACILITIES —
WHAT LEVEL OF COMFORT DO YOU HAVE?
>>I’M USED TO IT WORKING IN THE ACF. IT HAPPENS.
THEY SAY ONE THING AND WHEN YOU GET THERE, THEY CHANGE THEIR MIND.
WE NEED TO TRAIN ON BEING PREPARED IF THEY WANT TO DROP
OFF AND PICK UP AND WHEN YOU GET THERE THEY WANT SOMETHING ELSE.
THEY NEED TO BE PREPARED FOR THE OPTIONS OAR DO E-RESPONSE.
BEING PREPARED.
>>CAN WE GO TO THE LAST SLIDE. I KNOW PEOPLE WANT TO GO TO
BREAK. I THINK WHAT I WANT TO TAKEAWAY
IS REMEMBER THE TEST ISN’T OVER JUST BECAUSE WE CLOSED OUT A LOT
OF THESE OPERATIONS. THE GQE OPERATION WILL RUN INTO
AUGUST AS WELL THE CLOSE OUT OF THE DATA CAPTURE OPERATIONS.
OF COURSE WE HAVE TO DO ALL THE STUFF THAT GOES ON BEHIND THE
SCENES WHEN PEOPLE DON’T SEE WHAT’S HAPPENING WITH
POST-COLLECTION PROCESSING AND TABULATION AND ALL THE STEPS
REQUIRED TO MAKE A DATA PRODUCT. WE’LL TALK ABOUT THOSE MORE AS
WE MOVE THROUGH THE P.M.R.s LATER THIS YEAR.
I BELIEVE THAT WRAPS UP OUR 2018 TEST UPDATE.
AL, ARE YOU IN CHARGE OF BREAK?>>THANK YOU VERY MUCH STEPH AND TEAM.
WE WOULD LIKE YOU TO TRY TO TAKE A BREAK AT THIS POINT AND IF WE
COULD ASK YOU ALL TO BE BACK IN YOUR PLACES BY 3:25 TO GET
STARTED AGAIN. THANK YOU VERY MUCH. I’M GLAD YOU REJOINED UTS FOR
— US FOR THE AFTERNOON SESSION. AND WE’LL GET AN UPDATE ON OUR
SYSTEMS READINESS.>>GOOD AFTERNOON, LADIES AND
GENTLEMEN. THIS IS THE MOST INTERESTING
PART OF THE P.M.R.
I’M HAPPY TO BE HERE TO GIVE YOU ALL AN UPDATE ON THE SYSTEM
READINESS FOR THE NOT ONLY 2018 TEST BUT 2020 CENSUS.
THE SYSTEMS INCLUDE SET CAP SYSTEMS
AND WE CONCLUDED THE TEST AND ARE
GETTING READY TO LOOK AT DATA PRODUCT AND DISSEMINATION AND
REDISTRICTING DATA OPERATIONS.
WHAT WE PUT TOGETHER IS TO PUT THE LEVERS SUPPORTING THE
SYSTEMS AND GO OVER THE SYSTEMS TO BE DEPLOYED AND THEN TALK
ABOUT GETTING READY FOR THE 2020 COUNCIL INCLUDING THE
PERFORMANCE AND SCALEABILITY TEST PLAN, THE SYSTEMS RELEASE
PLAN AND REMAINING KEY WORK.
WE HAVE THE OPERATIONS OF INTERNET SELF-RESPONSE, NON-I.D.
PROCESSING QUESTIONNAIRE ASSISTANCE QUESTION AND PAPER DATA CAPTURE AND FIELD
ENUMERATION AND NON-RESPONSE FOLLOW-UP, 31 SYSTEMS WERE INVOLVED.
THE ENUMERATION TOOK PLACE AS PART OF THE ENUMERATION RELEASE
AND THAT FUNCTIONED SUCCESSFULLY FOR THE TEST AND PLAYED A
CRITICAL ROLE FOR THE NON-RESPONSE FOLLOW-UP.
THE SYSTEMS SUPPORTED COVERAGE IMPROVEMENT AND FIELD
VERIFICATION ASPECTS OF THE TEST.
THE RECORDING, THE THIRD ROW AS YOU SEE, IS WHERE RESPONSES THAT
COULD NOT BE WILL RECORDED ARE IDENTIFIED AND ACTION TAKEN TO
CODE THEM WITH INTERVENTION FROM SUBJECT MATTER EXPERTS.
GROUP QUARTERS RELEASED AND THERE WERE GROUP
QUARTERS ENUMERATION IS ONGOING AND ENTAILS MULTIPLE MODES OF
DATA COLLECTION INCLUDING COLLECT TRONIC UPLOADS FOR —
ELECTRONIC UPLOADS FOR E-FORMAT AND PAPER WHICH CONTAINS
DROP-OFF AND PICK UP AND ENUMERATION AND ENUMERATION AND IT CAN BE EVENT
FOR REFERENCE WE PROVIDED THE SYSTEMS LIST AND THE BACKUP
SLIDES THAT CONTAIN FULL NAME OF EACH OF THE 52 SYSTEMS AND DEVELOPMENT AND
TESTING AND FUNCTIONALITY EACH IS EXPECTED TO DEVELOP AND THE
DEVELOPMENT AND TESTING OF INTERFACES A SYSTEM MAY HAVE IN RELATION.
THE E.K. OPERATIONAL CONTROLLED SYSTEM HAS TO MANAGE FIELD
ENUMERATION ACTIVITIES INCLUDING GROUP QUARTERS WHILE AT THE SAME
TIME MANAGING SELF-RESPONSE ACTIVITIES.
THE INCREMENTAL RELEASES LEFT TO THE CONSOLIDATION AND
FUNCTIONALITY AND INTERFACES EACH SYSTEM NEEDED TO SUPPORTED
MULTIPLE OPERATIONS AND DOES THE ’18 TEST IS PROVING IN THE
RELEASE PROCESS FOR THE 2020 CENSUS.
THERE ARE TWO MAIN RELEASES LEFT.
THE RESPONSE PROCESSING RELEASE AND CONDUCT OPERATION DATA AND
DATA CREATION AND DISSEMINATION WITH CONDUCT OPERATION DATA
JANUARY 7, 2019. THE RESPONSE PROCESSING
INCLUDING DUPLICATION OF RESPONSES, QUALITY ASSESSMENT OF
DATA AND CREATIONAL DATA CENSUS FILE OF THE CUFF, AS WE CALL IT.
THE LAST RELEASE INCLUDES TABULATION, CREATION OF CENSUS
EDITED FILE AND THE MICRO DATA FILE, MDF AND DEMONSTRATION OF
PRODUCT FOR DISSEMINATION SUCH AS PUBLIC LAW 94, 171,
REDISTRICTING DATA PRODUCTS. THIS LAST RELEASE INVOLVES 11
SYSTEMS. WE’RE EAGER TO COMPLETE THESE
REMAINING ASPECTS OF THE ’18 TEST AND ON TRACK TO RELEASE
THEM FOR THE SCHEDULE END DATES SHOWN ON THE SCREEN.
THIS SLIDE SHOWS THE KEY SYSTEMS SUPPORTING THE REMAINING
RELEASE. THE PROCESSING SYSTEM, THE RPS,
PLAYS A CRITICAL ROLE IN RESPONSE PROCESSING AND
INCORPORATES THE COMPONENT OF DISCLOSURE AVOIDANCE.
AND CLARIFICATION REGARDING FRAUD DETECTION.
WHAT WE’RE LOOKING FORWARD TO IN FRAUD DETECTION SYSTEM, FDF IN
THE SYSTEM’S LIST IS A SYSTEM FOR SELF-RESPONSE QUALITY
ASSURANCE. WE GAVE A TECHNICAL DIRECTIVE TO
THE TECHNICAL INTEGRATOR TO DEVELOP THAT SYSTEM WITH US BUT
WE SHOULD HAVE CALLED IT BY THE NAME SPECIFIC TO WHAT IT IS
ACTUALLY INTENDED TO DO WHICH IS SELF-RESPONSE QUALITY ASSURANCE.
BECAUSE IT’S PART OF OUR OVERALL DATA QUALITY AND DATA INTEGRITY
CONTROL INVOLVING MULTIPLE SYSTEMS IN MULTIPLE OPERATIONS,
IT ALSO FALLS UNDER THE UMBRELLA OF FRAUD DETECTION.
BUT IT IS NOT THE ONLY SYSTEM RESPONSIBLE FOR FRAUD DETECTION.
SO FOR EVERYONE’S CLARITY AS WE MOVE TOWARDS THE 2020 CENSUS,
THEY’RE IMPLEMENTING A CHANGE REQUEST TO RENAME THE SYSTEM
APPROPRIATELY TO SELF-RESPONSE QUALITY ASSURANCE SYSTEM. THERE ARE TWO SYSTEMS THAT WILL BE RELEASED.
THE TABULATION AND [INDISCERNIBLE]
SYSTEM FOR DISSEMINATION. LET ME GIVE MORE DETAILS ON THE
SYSTEMS YET TO BE DEPLOYED IN TERMS OF THE CENSUS TEST.
THE SELF-RESPONSE QUALITY ASSURANCE SYSTEM WILL HAVE THE
ABILITY TO RUN CUSTOM-BUILT SYSTEM MODELS TO
IDENTIFY FRAUDULENT RETURNS AND THEY’LL BE RUN AT BATCH IN THE
CONCLUSION AT THE END-TO-END CENSUS TEST AND
DETERMINE THE LIKELIHOOD POTENTIAL RESPONSE POTENTIALLY
FRAUDULENT IN TERMS OF ACCUMULATIVE TRENDS IN TERMS OF
TEMPORAL AND GEOSPATIAL. THE FRAUD DETECTION TEAM WILL
HAVE A GROUP OF TESTERS OUTSIDE OF FRAUD DETECTION TEAM WILL
INTENTIONALLY INTRODUCE THE DATA THE SYSTEM IS SYSTEM IS
PROCESSING AND ALLOW THE FRAUD DETECTION TEAM TO DETERMINE
WHETHER THE SYSTEM CAN IDENTIFY THE FRAUDULENT RESPONSES AND WHAT ADJUSTMENTS ARE NEEDED.
CAPABILITIES FOR THE 2020 CENSUS THE SELF-RESPONSE SECURITY TEAM THEY HAVE DRMD THE
FIRST IMPLEMENTATION OF DASHBOARD AND VISUALIZATIONS
WHICH WILL CONTINUE TO BE ADVANCED AND DETERMINE MORE
EFFICIENCY AND AREAS FOR IMPROVEMENT.
THE TEAM WILL CONTINUE TO REFINE AND UPDATE THE MODELS BASED ON
THE FINDINGS FROM ROUTINE TESTING AND ANY NEWLY IDENTIFIED
FRAUD VECTORS. THEY’LL ALSO STAND UP AND TEST
THE FRAUD DETECTION OPERATION CENTER AND CASE MANAGEMENT
SYSTEM TO EVALUATE HOW ANALYSTS WILL ADJUDICATE SUSPECTED FRAUD
USING DASHBOARDS AND USER INTERFACES.
THE TEAM HAS ALREADY PROCURED A CASE MANAGEMENT SOLUTION AND
WORKING TO CUSTOMIZE THE SOLUTION FOR THE OPERATION
CENTER. WHILE THE FRAUD DETECTION
OPERATION CENTER AND CASE MANAGEMENT WERE NOT INCLUDED IN
THE ’18 TEST, THE TEAM IS PLANNING ON PERFORMING SMALL
MANY OF SCALE TESTING BEFORE 2020 TO ENSURE THE SYSTEM IS
READY FOR 2020. REGARDING THE TABULATION SYSTEM,
MOST OF ITS WORK WILL BE THROUGH BATCH PROCESSING.
SOME WILL PRODUCE VARIOUS PRODUCTS INCLUDING DETAILED
TABLES AND GEOGRAPHIC COMPARISON TABLES FOR DELIVERIES AND WILL
SUPPORT ALL THE GEOGRAPHIC SUMMARY LEVELS.
THE THIRD SYSTEM WILL HAVE METADATA APPLICATION AND WILL
HAVE AMERICAN FACT FINDER WITH MANY ADDITIONAL CAPABILITIES.
SPECIFIC TO THE ’18 TEST THE SYSTEM WILL HAVE EMBARGO, THE
ABILITY TO SUPPORT SECURE RESTRICTED ACCESS BY STATE
REPRESENTATIVE, LARGE BULK DOWNLOAD CAPABILITIES AND HIGH
PERFORMANCE OF ACCESSING ALL GEOGRAPHIC VIM LEVELS DOWN TO
THE BLOCK LEVEL. ALL THREE SYSTEMS ARE ON TRACK
TO BE DELIVERED ON TIME. NEXT SLIDE, PLEASE.
THIS SLIDE SUMMARIZES THE KEY FUNCTIONS THAT ARE SUPPORTED BY
SYSTEMS AS PART OF THE ’18 TEST. AS MENTIONED EARLIER WE HAVE
RESPONSE PROCESSING TABULATION, PRODUCT CREATION AND
DISSEMINATION REMAINING ALONG WITH THE ONGOING WORK WITH GROUP
QUARTERS AND ENUMERATION IN THE FIELD USING A COMMERCIAL CLOUD
SOLUTION WITH OUR DATA CENTER AND THE ESTABLISHED NETWORK AND
SECURITY OPERATION CENTERS. YOU MADE THE UTILIZATION OF
ADMINISTRATIVE RECORDS POSSIBLE AND BUILT PROCESSES USING
SYSTEMS THAT MINIMIZE USER PAPER INCLUDING FOR RECRUITING,
ON-BOARDING, TIME AND EXPENSE AND PAYROLL.
WE ESTABLISHED IN OUR OFFICE DISCOUNTING CAPABILITY WITH MORE
WORK BEING DONE IN OFFICE THAN IN THE FIELD.
WE ARE COLLECT ORG COLLECTING RESPONSES USING INTERNET
INCLUDING NON-I.D., TELEPHONE AND PAPER.
WE CONDUCTED LEAD OPERATION IN THE FIELD USING THE LISTING AND
MAPPING APPLICATION ON WINDOWS PLATFORM AS IN THE FIELD.
WE’RE OPTIMIZING CASE ASSIGNMENTS AND USING iPHONES TO
RUN THE ENUMERATION APP TO COLLECT RESPONSES AS PART OF THE
NON RESPONSE FOLLOW-UP. WE BUILT THESE CAPABILITIES
UNDER THE SYSTEMS ENGINEERING AND INTEGRATION FRAMEWORK
DEFINED BY OUR CTOs OFFICE AND ARE IMPLEMENTING MEASURES TO
ENSURE SECURITY OF OUR SYSTEMS AND DATA USING THE GUIDANCE OF
OUR OFFICE OF INFORMATION SECURITY.
I WANT TO LINK BACK TO THE ENUMERATION AREAS FOR THE 2020
CENSUS YOU MAY RECALL OPTIMIZING SELF-RESPONSE, USER OF
ADMINISTRATIVE RECORDS AND RE-ENGINEERING RECORDS AND BUILT
THOSE WITH THOSE AREAS IN MIND AND THIS TIME I’LL VOTE YOU ALL
THINK FOR A MOMENT AND RELAY THE FUNCTIONS WE IMPLEMENTED SHOWN
ON THE SCREEN TO THOSE FOUR INNOVATION AREAS.
PROGRESS HAS INDEED BEEN MADE BUT WE STILL HAVE QUITE A BIT OF
WORK TO DO. FIRST, WE’LL NEED TO FINISH THE
DATA IN PARALLEL OUR FOCUS IS ON THE MOST IMPORTANT ASPECT OF
SYSTEMS READINESS WHICH IS PERFORMANCE AND SCALEABILITY
TESTING. NEXT SLIDE.
ON THE SCREEN ARE THE FOUR [INDISCERNIBLE]
OF PERFORMANCE AND SCALEABILITY TEST AND THE FOUR-PHASE APPROACH
IS TYPICALLY TAKEN IN THE INDUSTRY.
AT FIRST, EACH SYSTEM FUNCTIONALLY READY IS ASSESSED
OR THE ABILITY TO SCALE WHETHER REVIEWING THE IMPLEMENTED
ARCHITECTURE AND DESIGN. THE SYSTEM TEAM THAT BUILT THE
SYSTEM IS INFORMED OF ANY OBVIOUS ISSUES TO BE ADDRESSED
AS AN EXAMPLE OF THE METHOD TO CONNECT TO THE DATABASE.
ONE CONNECTION VERSUS A POOL OF CONNECTIONS AND BASED ON
INFORMATION GATHERED THROUGH THE ASSESSMENT IS SCALING APPROACH
FOR EACH SYSTEM IS DETERMINED TYPICALLY WITH HORIZONTAL ONE
DATABASE SUPPORTING MULTIPLE DATABASES, ETCETERA.
BUT PLEASE NOTE ALL OF OUR 52 SYSTEMS WILL GO THROUGH PHASE
ONE. THE SYSTEMS ARE ASSESSED IN A
PRIORITIZED ORDER BASED ON THE NEED TO BE READY FOR PRODUCTION
AS PART OF AN INTEGRATION OF SYSTEMS AND
PHASE TWO IS INDIVIDUAL SYSTEMS ON STANDARD INFRASTRUCTURE BUT
ISOLATED. THESE TEST ESTABLISH BASELINE
NUMBERS, FOR INSTANCE, HOW MANY CONGRUENT USERS CAN A SYSTEM
TAKE ON A STANDARD CONFIGURATION.
PHASE II RESULTS HELP US VALIDATE SIZING AND SCALEABILITY
NUMBERS AND PERFORMANCE TESTS IN PHASE III CONCENTRATING ON EACH
BUSINESS THREAD FIRST AND EXPANDING TO FULL END TO END
TESTS. INTEGRATED PERFORMANCE TEST
ESTABLISH THE PERFORMANCE NUMBERS WITH
EMPHASIS ON THE NUMBER AND PEAK LOADS THROUGH EXTERNAL AND
INTERNAL NUMBERS ADJUSTMENTS ARE MADE TO THE NETWORK AND SOFTWARE
AND HARDWARE CONFIGURATION AND TESTS ARE PERFORMED TO ENSURE
THE SYSTEM OF SYSTEMS CAN SCALE. THESE PERFORMANCE TESTS ARE
REPEATED UNDER VARIOUS SCENARIOS SUCH AS WHEN BACK-UPS ARE
RUNNING. IN PHASE IV, THE SYSTEM OF
SYSTEMS IS SUBJECTED TO SOAK WHICH IS BASICALLY LETTING THE
SYSTEMS RUN FOR A PERIOD OF TIME AT PEAK LOADS AND FAILOVER TESTS
AND THE ASSOCIATED SCALEABILITY TESTS ARE CONNECTED.
ALL THESE TESTS ARE REPEATED UNTIL THERE’S CONFIDENCE IN OUR
ABILITY TO MEET THE NON-FUNCTIONAL AND SCALEABILITY
ENVIRONMENTS OF THE 2020 CENSUS. ALL THROUGH THE PHASES ARE
PERFORMANCE ENGINEERS, ARCHITECTS AND SUPPORT ENGINEERS
FROM ACROSS THE ORGANIZATION MONITOR, TROUBLE SHOOT AND
VALIDATE PERFORMANCE TEST RESULTS AND BY DESIGN THE
PERFORMANCE TO TEST ARE TO BE COMPLETED BY THE PRODUCTION OF
THE REVIEW DATES PUBLISHED IN OUR SCHEDULES.
NEXT SLIDE, PLEASE. LET ME NOW TALK ABOUT THE 2020
CENSUS SYSTEM RELEASES. LATER ON JACKIE WILL GIVE MORE
DETAILS ON THE SCHEDULE FOR THESE.
AS YOU ALL HEARD IN THE LAST FEW P.M.R.s, WE HAVE FOUR RELEASES
FOR 2020 CENSUS. BASED ON THE LESSONS LEARNED
FROM THE ’18 TESTS AND FEEDBACK FROM VARIOUS SOURCES, WE WORKED
WITH SYSTEM TEAMS, TECHNICAL INTEGRATOR, ESPECIALLY THE TEAM
THAT DOES THE PERFORMANCE AND SCALEABILITY TESTING.
WE WORKED WITH FIELDS AND THE CONTRACTORS
[INDISCERNIBLE] WE WORKED WITH COMPUTER SERVICES
DIVISION, OFFICE OF INFORMATION SECURITY, SYSTEMS ENGINEERING
AND INTEGRATION AREA AND OPERATIONS MANAGERS TO PROVIDE
MORE GRANULARITY TO EACH OF THE FOUR RELEASES BY ADDING MORE
DETAIL. AS YOU ALL KNOW THERE ARE 35
OPERATIONS AND 52 SYSTEMS FOR THE 2020 CENSUS.
NOT ALL OPERATIONS ARE [INDISCERNIBLE]
AT THE SAME TIME AND NOT ALL SYSTEMS SUPPORT EACH OPERATION.
THE FOUR RELEASES WERE CREATED AT A VERY HIGH LEVEL DIVIDING
THEM UP FOR RECRUITING, [INDISCERNIBLE]
PEAK OPERATIONS AND RESPONSE PROCESSING.
AS YOU CAN IMAGINE, THAT TYPE OF DIVISION HANDLING OF LARGE
NUMBER OF SYSTEMS FOR PERMUTATIONS OF OPERATIONAL
THREADS, EACH THREAD REQUIRING ITS OWN DATA, PERFORMANCE AND
SCALEABILITY ASSESSMENT AND INPUT AND OUTPUT TESTING AND
WHERE RELEVANT, TRAINING. EVERY ONE NEEDED A BETTER ORGANIZED APPROACH TO HANDLE
THEM EFFICIENTLY WITH THE ABILITY TO SOFT LAUNCH EACH
OPERATION. THE RESULT OF THE EFFORT TO
ARRIVE AT TAY MORE DETAILED APPROACH IS THAT WE CONVERT THE FULL RELEASES INTO 16
OPERATIONAL DELIVERIES FOR EACH ISLAND AREAS AND ENUMERATION
SURVEY AND THE INTEGRATION FRAMEWORK REMAINS THE SAME WITH
SPECIFIC TEST READINESS, PRODUCTION READINESS AND CONDUCT
OPERATION DATES IDENTIFIED FOR EACH OPERATIONAL DELIVERY.
ONCE THE OPERATIONAL DELIVERY DATES HAVE INTEGRATED INTO THE
IMS, WE’LL PUBLISH THEM. WE’RE ALSO TREME — STREAMLINING
THE REVIEW TO ALLOW THE SYSTEM TEAMS TO PROACTIVELY PROVIDE
SYSTEMS TO THE SYSTEM’S INTEGRATION TEAMS AND
PARTICIPATE IN ELECTRONIC READINESS REVIEWS, NEXT SLIDE,
PLEASE. THIS IS MY FINAL SLIDE.
IT IDENTIFIES THE REMAINING KEY WORK FOR 2020 COUNCIL.
— CENSUS. WE HAVE TO IDENTIFY THE DALE
BETWEEN THE ’18 TEST AND 2020 CENSUS.
EXAMPLE THE ORIGINAL LANGUAGE FOR THE INTERNET-RESPONSE SYSTEM
AND PUERTO RICO WHERE THERE’S A SPECIFIC DEFINITION AND
STRUCTURE AND THE IMPLEMENTATION OF ENHANCEMENTS OR IMPROVEMENTS
BASED ON LESSONS LEARNED FROM THE ’18 TESTS.
THEN WE NEED TO CONDUCT INTEGRATION TESTING OF SYSTEMS
INCLUDING THE EIGHT SYSTEMS THAT WERE NOT PART OF THE ’18 TESTS.
THE INTEGRATION TESTS IS THE PERFORMANCE AND SCALEABILITY
TESTING WITH ALL TESTS COMPLETING BY THE READINESS
REVIEW DATES. BASED ON THE PERFORMANCE AND
SCALEABILITY TEST RESULTS AND TAKING INTO CONSIDERATION THE
SECURITY CONFIGURATIONS, THE FINALIZATION OF CLOUD DEPLOYMENT
ARCHITECTURE NEEDS TO TAKE PLACE.
AS YOU ALL KNOW, WE TAKE CYBER SECURITY VERY SERIOUS BUT AND
BASED ON MANY TESTS THAT KEVIN TALKED ABOUT WE NEED TO
STRENGTHEN THE SECURITY ARCHITECTURE AS NEEDED.
ALSO IN PADLO WE NEED TO DEPLOY THE NEEDED AT EACH ACO ACROSS THE NATION.
WE KNOW WE HAVE A LOT OF WORK TO DO BEFORE THE 2020 CENSUS AND
ALL OF OUR STAFF MEMBERS AND FEDERAL EMPLOYEES AND
CONTRACTORS ARE COMMITTED AND DEDICATED TO DELIVER ALL NEEDED
SYSTEMS AND INFRASTRUCTURE THAT MEET THE CAPABILITY OF
NON-FUNCTIONAL REQUIREMENTS FOR AN ACCURATE AND EFFICIENT
CENSUS. I’LL BE HAPPY TO TAKE ANY
QUESTIONS AT THIS TIME.
>>WE THANK YOU VERY MUCH. WE ARE NOW GOING TO TURN IT OVER
TO JIM TRITE. HE WILL LEAD HIS DISCUSSION IN
SCHEDULING AND RISK ASSESSMENT AND THOSE KEY FUNCTIONALITY THAT
DRIVE THE CENSUS BUT YOU DON’T SEE THEM.
THEY’RE IN THE BACKGROUND UNLIKE A FIELD OPERATION BUT THEY’RE
CRITICAL TO OUR MANAGEMENT OF THE SYSTEM PROCESS.
THE INTEGRATED MASTER SCHEDULE BASICALLY DRIVES EVERYTHING WE
DO AND MAKES SURE IT STAYS ON TIME AND ON TRACK.
OUR RISK ASSESSMENT ALLOWS US TO LOOK AT CHANGES IN THE
ENVIRONMENT AS THEY IMPACT US IN INTERNAL AND EXTERNAL THINGS AND
HOW WE NEED TO BUILD CONTINGENCY PLANS TO RESPOND IN THE EVENT OF
A RISK BECOMING AN ISSUE.>>THANK YOU, AL.
TODAY’S PRESENTATION — THE MAJORITY HAVE BEEN FOCUSSED ON
THE END-TO-END TEST WHICH IS GREAT BECAUSE THERE’S BEEN A LOT OF INFORMATION KNOWLEDGE
AND LESSONS LEARNED AND WE’RE TRANSITION TO A MORE BROADER
PERSPECTIVE AS IT RELATES TO THE PROGRAM MANAGEMENT AREAS FOR THE
2020 CENSUS PROGRAM I MEAN BROADLY.
NOT THE EXECUTION PART OFF THE 2020 CENSUS BUT THE LARGER
ELEMENTS OF THE PROGRAM WHICH INCLUDES THE END TO END TEST AS
WELL AS THE TEST THAT PRECEDE THE 2018 END TO END TEST.
AS AL SAID WE HAVE TWO PRESENTATIONS THIS AFTERNOON.
THE FIRST IS WITH JACKIE EINS OVER AT THE SCHEDULE MANAGEMENT
STAFF AND WILL TALK ABOUT HOW WE MANAGE, DEVELOP, MANAGE AND
IMPLEMENT A CRITICAL COMPONENT WHICH IS THE INTEGRATED MASTER
SCHEDULE AND HOW WE USE THAT. ON THAT I’LL TURN IT OVER TO JACKIE.
>>THANK YOU, JIM. I THINK ATRI MADE UP SOME TIME.
I’LL TRY TO KEEP THE TREND ALIVE.
I’LL TALK TO YOU A LITTLE BIT TODAY — TOUCH ON THE COMPLEXITY
OF THE 2020 CENSUS.
I’LL INTRODUCE THE INTEGRATED MATTER SCHEDULE AND TALK ABOUT
THE RESPONSIBILITIES AND GO OVER THE PROCESS AND WRAP-UP WITH THE
STATUS OF OUR CURRENT IMS. SO THE 2020 CENSUS IS A LARGE
COMPLEX PROGRAM CONSISTS OF MULTIPLE PROJECTS THAT REPLY ON
PEOPLE, FACILITIES, MATERIALS, SYSTEMS, DATA, PROCEDURES AND
CONTRACTS. IT INTEGRATES 35 OPERATIONS
ACROSS 52 SYSTEMS AND SPANS MULTIPLE YEARS THOUGH WE HAVE A
HIGH LEVEL OF ACTIVITY OVER A SIX TO NINE-MONTH PERIOD OF TIME
REFERRED TO AS PEAK OPERATION. WE HAVE UNFORGIVABLE DEADLINES
ALL WITH THE GOAL TO COUNT EVERYONE ONCE AND ONLY ONCE AND IN THE RIGHT PLACE.
SO I THINK THIS IS FAMILIAR. THIS SOUR PLACE MAT.
ATRI SHOWED A DIFFERENT VERSION AND REPRESENT THE OPERATIONS AND
WITHIN THE BOX ARE THE SYSTEMS THAT SUPPORT THOSE OPERATIONS.
YOU CAN SEE IT ALL HAS TO COME TOGETHER TO MEET OUR ULTIMATE
GOAL. NEXT SLIDE, PLEASE.
THIS IS ANOTHER CONTEXT USE SIMPLE MODEL OF A FIVE-OPERATION
PROGRAM. WITHIN THAT THERE’S A MAXIMUM OF
10 INTEGRATION POINTS. IF WE APPLY THE SAME FORMULA TO
THE 2020 PROGRAM, WE HAVE A MAXIMUM OF 3,371 INTEGRATION
POINTS. WE RELY ON OUR INTEGRATED MASTER
SCHEDULE TO MANAGER ALL THE RELATIONSHIPS.
SO WHAT IS THE IMS, THE INTEGRATED MASTER SCHEDULE AND
COMPLEX SCHEDULE THAT CONSISTS OF 87 PROJECTS.
WE HAVE 24,000 ACTIVITIES — PLUS AND 47,000 PLUS
RELATIONSHIPS. WE IMPLEMENT A TIERED STRUCTURE
FOR CAUSE AND EFFECT SCHEDULING. THIS MEANS THAT MOVEMENT AT THE
LOWER TIERS IMPACTS MILESTONES AT THE HIGHER TIERS.
WE USE ORACLE PRIMAVERA TO MANAGE THE SCHEDULE.
THESE ARE THE ARCHITECTURE AND TIER 1 REPRESENTS OUR HIGHEST
LEVEL MILESTONES FOR 2020 SUCH AS PORTION ACCOUNTS AND DELIVERY
OF THE REDISTRICTING SUM I HAVE — SUMMARY STYLES.
AT THE TIER 2 IS WHERE THE 35 OPERATION AND 52 SYSTEMS ALIGN
TO. TIER 3 IS A FURTHER BREAKDOWN
AND THE MILESTONES AND HIGH-LEVEL ACTIVITIES. ONE EXAMPLE IS CENSUS DATA OR
GROUP QUARTERS. AND TIER 4 ARE DETAILED
SCHEDULES AND THE DAY TO DAY OPERATIONAL SCHEDULES FOLLOWING
THE GQ EXAMPLE THAT WOULD BE SOMETHING LIKE DELIVER TABULATED
ACCOUNTS FROM DoD FOR OVERSEAS PERSONNEL TO THE FEDERAL
AFFILIATED COUNT OVERSEAS SO A VERY DETAILED LEVEL. SO THAT DESCRIBES THE
ARCHITECTURE OF THE SCHEDULE ITSELF.
I WANT TO TALK ABOUT THE SCHEDULE MANAGEMENT BRANCH AND
THEIR ROLE IN SUPPORTING THAT. SOMEWHERE RESPONSIBLE FOR
DEVELOPING, MANAGING AND OPERATING THE SCHEDULE SYSTEM
WITHIN PRIMAVERA. WE WORK WITH THE PROJECT MANAGER
TO BUILT THE SCHEDULES AND INTEGRATE THEM IN THE IMS AND
ENSURE ALIGNMENT TO OUR BEST PRACTICES AND STANDARDS AND
RESPONSIBLE FOR MANAGING THE BASELINE SCHEDULES VIA THE
PROCESS AND PRODUCING STANDARD AND AD HOC SCHEDULED REPORTS AS
WELL AS PROGRAM STATUS TO CENSUS BUREAU LEADERSHIP.
I SEE THE CYCLE AND THAT FOLLOWS THE OPERATIONAL WORK FLOW AND
BREAK IT DOWN TO THE TIER 1 THROUGH TIER 3 AND REVIEWED DOWN
TO THE FINEST LEVEL OF DETAIL AND MOVE INTO THE MONITORED
PHASE. AT THE PROJECT LEVEL IN THE
MIDDLE PORTION OF THE DIAGRAM, THIS IS THE WEEKLY CADENCE AND
THE TIER 4 SCHEDULE WHERE WE WORK WITH THE PROJECT MANAGERS
TO ENSURE ACCURATE LINKAGES AND BASELINE AND STATUS AND MONITOR
AND I’LL SPEAK DIRECTLY TO THAT WITH THE OUTPUT BEING THE WEEKLY
REPORT I’LL TOUCH UPON AND ON THE BOTTOM IS THE SCHEDULED
REPORT I WENT OVER THE RULES AND RESPONSIBILITIES FOR. I WANTED TO PROVIDE A LIST OF
THE BEST PRACTICES. THESE ARE WHAT WE USING AS THE
PRIMARY GUIDELINE TO ENSURE A COMPLETE AND ACCURATE 2020
SCHEDULE THINGS SUCH AS 100% SCOPE, ACCURATE AND REASONABLE
DURATIONS AND EVERYTHING IS LOGICALLY LINKED THEREBY SUPPORTING THE TIERED
ARCHITECTURE. WE ALSO USED THE DEFENSE
CONTRACT MANAGEMENT AGENCY OR 14 POINT ASSESSMENT TO SUPPORT THE
IMS AND ENSURES WE STAY WITHIN THE QUALITY STANDARDS WE RUN
EVERY FEW WEEKS TO ENSURE WE STAY WITHIN CERTAIN THRESHOLDS. SO THOSE THE PROCESSES THE
SCHEDULED MANAGEMENT BRANCH SUPPORTS.
WE HAVE OTHER STAKEHOLDERS THE MANAGEMENT AND THEY ENSURE WE
HAVE COMPLETE SUPPORT AND PARTICIPATION WITH THE SCHEDULE
MANAGEMENT PROCESS. PROGRAM MANAGEMENT GOVERNANCE
BOARD HAS KEY STAKEHOLDERS RESPONSIBLE FOR REVIEWING AND
APPROVING THE 2020 CENSUS PROJECT DELIVERABLES AND THEN WE
HAVE THE PROJECT MANGERS. THEY’RE THE OWNERS OF THE
CONTENT OF THE TIER 4 SCHEDULES AND THEY ENSURE THEY’RE ACCURATE
AND STATUS AND USED TO MANAGE THE PROJECTS AND THE PROGRAM.
I WANTED TO PROVIDE A VISUAL. EVERY WEDNESDAY WE SEND STATUS
SHEETS OUT TO THE PROGRAM MANAGERS AND SEND BACK SCHEDULES BY FRIDAY.
AND HAVE A MEETING ON TUESDAY WHERE WE REVIEW VARIANCES AND
CREATING FINAL REPORTS ON WEDNESDAY AND THEN START THE CYCLE OVER AGAIN.
THEY PROVIDE INFORMATION FOR ANYTHING IN PROGRESS.
WE HAVE A LIST OF PLANNED TO START OR PLANNED TO FINISH AND
DON’T HAVE ACTUAL DATES APPLIED.
AND HAVE ACTIVITY FOR THE NEXT ONE, TWO AND THREE MONTHS AND
THEN A LIST OF HAND-PICKED ACTIVITIES BY THE OPERATIONAL
OWNERS OF KEY MILESTONE MUST OCCUR ON TIME TO DELIVER A
PORTION ON TIME TO MEET THE GOAL.
THAT’S IT FOR THE SCHEDULE MANAGEMENT PROCESS.
I MADE UP MY TIME AND GIVE YOU AN UPDATE WHERE WE ARE CURRENTLY
WITH THE SCHEDULE. WE BEGAN THE TIER 4 DEVELOPMENT
FOR THE 2020 CENSUS EXECUTION SCHEDULE LAST JULY AND BASELINED
IN DECEMBER.
WE OVER THE PAST SEVERAL WEEKS WE’VE BEEN WORKING WITH THE
OPERATIONS SYSTEMS AND TESTING PROJECT MANAGERS TO IN CORP
OPERATE THE CONVERTED RELEASES TO THE IMS WITH A TARGET DATE INTO THE
SCHEDULE AND DEDE RA HICKS WILL TALK ABOUT RISM AND THEN WE’LL
TALK ABOUT — RISK AND THEN WE’LL TALK ABOUT QUESTIONS.
>>SHE’S THE ASSISTANT DIVISION CHIEF OVER THE PROGRAM
MANAGEMENT AREA UNDER DOUG’S DIVISION IN THE CENSUS MANAGEMENT DIVISION.
>>THEY’VE BEEN WORKING ON THESE SINCE THE 2010 CYCLE.
OVER THE PAST DECADE WE HAVE STRENGTHENED OUR PROCEDURES AND
THIS WILL DISCUSS OUR STRUCTURE FOR RISK MANAGEMENT, GIVE AN
OVERVIEW OFF THE PROCESS, GOVERNANCE AND REPORTING AND
WALK OVER THE PORTFOLIO RED RISKS.
JACKIE SHOWED YOU A TRIANGLE THAT ILLUSTRATES THE TIERS
WITHIN THE SCHEDULE. SIMILARLY THE RISK MANAGEMENT
PROCESS USES A TIERED APPROACH AND COMPRISED OF THE OPERATIONS
AND EACH ESSENTIALLY ARE PROGRAMMED WITHIN THEMSELVES.
IT IS CRITICAL WE MANAGE RISK WITHIN EACH OF THE 35 PROGRAMS
AND THAT WE LOOK ACROSS THE PROGRAMS AND DERIVE OVER ARCHING
RISKS. THESE ARE OUR PORTFOLIO LEVEL
RISKS. IN ADDITION WITHIN EACH PROGRAM
ARE PROJECTS AND SUBPROJECTS.
THIS ENSURES WE ARE MONITORING RISK AT ALL LEVELS OF THE 2020 CENSUS.
ON THIS SLIDE ILLUSTRATES THE MANAGEMENT WITHIN THE RISK
MANAGEMENT STRUCTURE. ONE LEVEL BELOW PORTFOLIO IS OUR
PROGRAM LEVEL RISK. HERE I’M USING SYSTEMS
ENGINEERING AND INTEGRATION AS AN EXAMPLE.
HERE’S THE PROJECTS THAT SUPPORT WHICH IS CED CAP AND AT THE
BOTTOM ARE SUBPROJECTS. IN THIS CASE ARE MAJOR
CONTRACTS. OUR INDICATED PROCESS ALLOWS
RISK TO BE IDENTIFIED, CAPTURED AND MONITORED AND REGULARLY
UPDATED AT ANY LEVEL FROM THE CONTRACTS TO THE SUBPROJECTS,
PROGRAM AND PORTFOLIO LEVELS. THE RISK MANAGEMENT PROCESS ALSO
INCLUDES THE ABILITY TO ESCALATE RISK AND TRANSFER RISK TO THE
APPROPRIATE LEVEL FROM ANY LEVELS THE RISK IS IDENTIFIED.
OUR PROCESS FOLLOWS INDUSTRY BEST STANDARDS AND ARE ALIGNED
WITH THE CENSUS BUREAU AND DEPARTMENT OF [INDISCERNIBLE]
STANDARDS. PORTFOLIO RISK IN THE 2020
CENSUS LIFE CYCLE AND COULD JEOPARDIZE OUR ABILITY TO
ACHIEVE OUR GOALS AND OBJECTIVES.
IN ADDITION, THESE RISKS ARE BROADLY DEFINED AND REPRESENT
THREATS TO THE SUCCESS OF THE PORTFOLIO RATHER THAN JUST TO AN
INDIVIDUAL PROGRAM OR PROJECT.
IN ADDITION, PORTFOLIO RISK HAVE THE POTENTIAL TO BE REALIZED
MORE THAN ONCE DURING THE LIFE CYCLE AND SPAN SEVERAL YEARS AND
REMAIN OPEN IN THE REGISTER UNTIL THE LAST POSSIBLE INSTANCE
IT COULD OCCUR AND CAN SPIN OFF MULTIPLE ISSUES.
HOWEVER, THE RISK MAY REMAIN IF IT STILL HAS THE POTENTIAL TO
OCCUR IN THE FUTURE AND MAY ELEVATE FROM THE PROGRAM,
PROJECT OR SUBPROJECT LEVEL.
THE 2020 CENSUS RISK REVIEW BOARD IS THE OVERALL GOVERNING
BODY INCLUDING REPRESENTATIVES ACROSS ALL THE PROGRAMS AS WELL
AS KEY STAKEHOLDERS AND CHAIRED BY THE DIVISION CHIEF.
THE RISK REVIEW BOARD IS RESPONSIBLE FOR MANAGES
PORTFOLIO LEVEL RISK INCLUDING IDENTIFYING, ASSESSING AND
PLANNING RISK RESPONSE AND MONITORING RISK.
IN ADDITION, THE RISK REVIEW BOARD ALSO REGULARLY REVIEW RISK
AT ALL LEVELS OF THE PROGRAM FROM THE 35 OPERATIONS,
PROJECTS, SUBPROJECTS AS WELL AS CONTRACTORS. NOW, A LITTLE ABOUT OUR REPORTING.
PORTFOLIO RISK — WE REGULARLY REPORT OUT ON OUR
RISK INCLUDING THE FOLLOWING DELIVERABLES, THE REPORTING TO
THE SENIOR MANAGERS AS WELL AS THE DEPARTMENT OF MANAGERS
INCLUDING OUR MITIGATION AND TREATMENT PLANS.
OUR CAPITAL PLANNING AND CONTROLLED REPORTING WHICH IS
THE E-300 WHERE WE DO MONTHLY REPORTING TO THE DEPARTMENT OF
COMMERCE AND MANAGEMENT AND BUDGET ON OUR FULL PORTFOLIO
RISK REGISTER AS WELL AS OUR TOP RISK ON A QUAD CHART.
WE ALSO REPORT OUT TO THE PORTFOLIO MANAGEMENT BOARD ON
THE QUARTERLY BASIS ON OUR TOP RED AND YELLOW RISKS.
NOW, I’D LIKE TO HIGHLIGHT A NUANCE IN OUR APPROACH TO
DETERMINING THE PROBLEM AND AND IMPACT OF OUR PORTFOLIO-LEVEL
RISK. THE PROBABILITY IS BASED ON THE
LIKELIHOOD OF THE RISK OCCURRING STANDARD FOR RISK MANAGEMENT,
HOWEVER THE IMPACT IS ASSESSED IN FIVE SEPARATE AREAS
INDIVIDUALLY LISTED ON THE SLIDE.
THEY INCLUDE COST, SCHEDULE, TECHNICAL, CUSTOMER EXPECTATIONS
AS WELL AS PUBLIC TRUST. THE HIGHEST RATING ACROSS EACH
OF THE AREAS BECOMES THE OVERALL IMPACT NUMBER MULTIPLIED BY THE
PROBABILITY TO DETERMINE OUR OVERALL RATING.
THIS APPROACH ALLOWS US TO DO MORE DETAILED ASSESSMENT OF THE
RISK IN EACH OF THE IMPACT AREAS.
NOW WE’D LIKE TO CIRCLE BACK AND TALK ABOUT OUR RISK THEMSELVES.
THE FIRST RED RISK THAT WE HAVE IS AROUND OUR ABILITY TO
SAFEGUARD RESPONSE DATA. THE PROBABILITY IS A THREE ON
THE IMPACT OF 5 AND THE AREA CREATING THAT IMPACT IS THE
PUBLIC PERCEPTION AROUND THIS RISK.
THIS RISK HAS AN ACTIVE MITIGATION PLAN INCLUDING STEPS
TO MONITOR THE PUBLIC’S CONFIDENCE IN A DATA SECURITY.
OUR SECOND IS AROUND CYBER SECURITY WHICH IS ALSO A
PROBABILITY AND IMPACT OF 5. THE IMPACT AREA DRINK —
DRIVING THE RATING IS AROUND TRUST AND WE’RE MITIGATING THIS
RISK INCLUDING MONITORING SYSTEM DEVELOPMENT EFFORTS TO ENSURE
PROPER IP SECURITY GUIDELINE FOLLOWED AND RESEARCHING OTHER
PROGRAMS AND GOVERNMENT AGENCY AND OTHER COUNTRIES AS WELL AS
PRIVATE SECTOR TO UNDERSTAND HOW THEY EFFECTIVELY MITIGATE CYBER
SECURITY INCIDENT AND ONGOING AUDITING OF SYSTEMS TO TRACE
INFILTRATION AND MONITOR ONGOING THREAT AND ANALYSIS.
OUR THIRD IS OUR TESTING OF PERFORMANCE MEASUREMENT REPORT
WHICH ALSO HAS A PROBABILITY OF 3 AND IMPACT OF 5.
THE IMPACT THEY’RE DESCRIBING IS AROUND CUSTOMER EXPECTATION AND
WORKING TO ENSURE OUR PERFORMANCE REPORTS ARE TESTED
AND ACCEPTED AND THIS IS A RELATIVELY NEW RISK TO THE
REGISTER BUT WE FEEL CONFIDENT THIS WILL CONTINUE TO PROGRESS
AND BE ABLE TO COME DOWN IN ITS PROBABILITY.
THEN I’LL WANT TO HIGHLIGHT IN RECENT MONTHS WE HAVE CONTINUED
TO REVIEW THE 2010 CENSUS REG STORE LOOK FOR RISK BROUGHT BACK
TO THE PORTFOLIO REGISTER. IN THIS PROCESS WE IDENTIFIED
TWO NEW RISKS THAT HAD BEEN RATED YELLOW.
THE FIRST IS DUPLICATE AND MISSING LIVING QUARTERS.
THIS WAS IDENTIFIED IN THE 2010 CYCLE AND NOW BROUGHT IT BACK AS
A YELLOW RISK. THE SECOND IS A RISK WITHIN
HOUSEHOLD PERSON OVER AND UNDER COVERAGE IN NUMEROUS
ENUMERATION. THIS RISK IS ONGOING AND AS WE
IDENTIFY NEW RISKS TO THE RISK REVIEW BOARD THEY’LL BE
ADDRESSED AND BECOME PART OF OUR RISKS.
AND AT THIS POINT WE’LL TAKE ANY QUESTIONS.
>>THIS IS LISA PEARSON FROM J.A.L.
WE WERE LOOKING AT THE TERMINOLOGY FROM THE RISK
ASSESSMENT JOB AND PORTFOLIO JOB AND WE TALK ABOUT RISK
ASSESSMENT BUT ON THE SCHEDULE WE’RE AT A PROGRAM AND PROJECT
LEVEL. IS THE TERMINOLOGY CHANGED
RECENTLY? HAS IT NOT CAUGHT UP TO THE
SCHEDULE YED YET OR IS THERE NOT GOING TO BE A PORTFOLIO SCHEDULE ASSESSMENT?
>>IT WAS BROUGHT RECENTLY AND THEY’VE BEGAN TO
REALIZE TO LOOK ACROSS THE BOARD WE ARE MANAGING A PORTFOLIO.
THESE OPERATIONS ARE MAJOR. THEY’RE NOT JUST PROJECTS BUT
PROGRAMS. YOU’RE RIGHT, TERMINOLOGY HAS
NOT FILTERED DOWN ACROSS EVERYTHING AT THIS POINT BUT
IT’S A WAY TO LOOK AT HOW WE DO BUSINESS AND REALIZE IT’S LARGER
THAN JUST THE PROGRAM.>>PART IS TOO WHEN YOU LOOK AT
THE 32 LARGE RISKS I WON’T USE PORTFOLIO PROJECT.
WHEN YOU LOOK AT THE 32 LARGE RISKS AS DEIDRE TALKED ABOUT
THEY’RE NOT WHAT YOU WOULD CONSIDER A PROJECT KIND OF RISK.
BECAUSE NORMALLY WITH PROJECT RISK THEY’RE SINGLE EVENT OCCUR
WHEN THEY GO FROM A RISK TO AN ISSUE YOU MANAGE TO
TRANSITIONING THE ISSUE AND WITH THE DECENNIAL CENSUS BECAUSE OF
THE LIFE SPAN AND SIZE OF IT AND COMPLEXITY, AT THE HIGHER LEVEL
WE COME UP WITH SOMETHING TO MANAGE BECAUSE AS DEIDRE SAID,
THESE ARE THINGS THAT CAN OCCUR MULTIPLE TIMES THROUGH THE
PROGRAM AND NEEDED TO FIGURE OUT HOW TO MANAGE THOSE IN THAT
EFFORT AND TRY TO BRING LANGUAGE TO ELEVATE IT TO THE TOP OF THE
OVERALL EFFORT THAT WE’RE DOING TO RAISE THAT VISIBILITY UP TO THAT LEVEL.
WHILE WE WRESTLE WITH TERMINOLOGY AND NOMENCLATURE THE
PROCESS WE’RE FOLLOWING LEVERAGE AND WHATEVER TERMINOLOGY USED
LEVERAGED WHAT WE DID FOR RISK AND SCHEDULE MANAGEMENT FROM
2010 AND BUILT ON THE LESSONS LEARNED AND IS TRYING TO TAKE IT
TO THE NEXT LEVEL FOR THE PROGRAM.
>>ANY ADDITION QUESTIONS? IF NOT I’D LIKE TO SAY JIM,
JACKIE AND DEIDRE. AND NOW WE’RE GOING TO TURN IT OVER TO MICHAEL TO CARRY US
MOMENT.>>THAT’S A GOOD WAY TO THINK OF
AN END OF A LONG DAY AT THEN OF A LONG WEEK.
I HAVE A LOT OF NOTES AND A POLL POLL — APOLOGIZE IF I HAVE TO
LOOK AT THEM. SIDE WAYS AND AL STARTED WITH
UPDATES AND OUR 2020 PREPARATION AND REMINDED EVERYBODY WE JUST
AWARDED OUR FIELD I.T. DEPLOYMENT CONTRACT THIS WEEK SO
WE’RE HAPPY ABOUT THAT. KEVIN SPOKE ABOUT OUR
COMPREHENSIVE APPROACH TO CYBER SECURITY.
TO ME THIS IS A KEY TAKEAWAY WE WANT TO KEEP IN YOUR MIND.
HE TALKED ABOUT HOW PRIVACY AND CONFIDENTIALITY ARE IN THE
CENSUS BUREAU’S DEEP CULTURAL DNA AND TALKED ABOUT IMPLEMENT
NETWORK SECURITY WITH EXPERTS ARE ON THE 2020 CENSUS TEAM AND
HAVE OUR BACKS. HE TALKED ABOUT OUR TECHNICAL
CAPABILITIES TO MAINTAIN AN ATTACK AND MAINTAIN THE USER
EXPERIENCE AND ADDRESSED HOW EMPLOYEES WILL SECURELY SIGN
INTO OUR APPLICATION AND HOW OUR DEVICE ENCRYPTED AT REST AND AT
MOTION AND THERE’S TWO-FACTOR AUTHENTICATION AND TALKED ABOUT
HOW WE WILL HANDLE THREAT FROM SOCIAL MEDIA ENGINEERING FROM
BAD ACTORS AND EXPERTS WILL HELP REVIEW WHAT WE BUILT.
THOUGH WE HAVE THE KEY, WITH YOU MUST KEEP OUR TECHNICAL PLANS TO OURSELVES.
OURSELVES. HE TALKED ABOUT HOW THE CENSUS
BUREAU AND FEDERAL GOVERNMENT ARE DEPLOYING A WORLD CLASS
PROGRAM FOR THE 2020 CENSUS. THESE ARE THINGS THAT ARE GOOD
TO KEEP IN MIND IN THIS ERA WHERE CYBER SECURITY IS WHAT
IT’S ALL ABOUT FOR THE CENSUS. THEN WE WENT TO DEB AND DEB GAVE ME MATERIAL AND
SAID IT’S HER FAVORITE P.M.R. BECAUSE SHE GETS TO HAND THINGS
OFF TO ALEXA AND OTHERS AND TALKED ABOUT PAPER, INTERNET AND
PHONE AND OUR STRATEGIC APPROACH TO DEPLOYING THOSE TO MAKE THE
CENSUS AS EFFICIENT AS POSSIBLE. JENNIFER CAME IN AND COVERED HOW
NON-RESPONSE FOLLOW-UP CREATED LEARNING FOR THE MOSTLY
ELECTRONIC CENSUS AND TOOK US DOWN MEMORY LANE COMPARING THE
2018 TEST TO THE 2010 CENSUS SHOWING CLEARLY HOW WE ENTERED
THE DIGITAL AGE AND COVERED ADMIN AND MADE NRFU MORE
EFFICIENT AND COVERED THE NON-RESPONSE FOLLOW-UP
CHALLENGES GET FROM THE 2018 TEST TO 2020 CENSUS COVERING
EVERYTHING WE LEARN AND WORK STILL TO BE DONE AND JUDY
COVERED OUR GQ AND ONGOING OPERATIONS AND MAKE ONE OF OUR
MOST COMPLEX OPERATIONS LOOK EASY.
ATRI TALKED ABOUT FUTURE SYSTEMS WORK INCLUDING THE NEW REPLANT
OF OUR OPERATIONAL DELIVERIES WE LEARNED SOME
RELEASES CAUSED US TO DO SOME THINGS IN OUR DEVELOPMENT WE
THOUGHT WE COULD IMPROVE ON FOR 2020.
JIM DID A NICE HANDOFF TO JACKIE AND DEIDRE.
JACKIE UPDATED US ON OUR EXCELLENT INTEGRATED MASTER
SCHEDULE AND WORK BEING DONE AND POINTING OUT OUR ALIGNMENT WITH
BEST PRACTICES. DEIDRE COVERED THE BEST
PRACTICES AND FOLLOW INDUSTRY AND DEPARTMENT OF COMMERCE BEST
PRACTICES BUT NOT MENTIONING DAO BEST PRACTICES AND FINALLY I
KEEP NOTICING IN OUR SLIDES — WE HAVE DEADLINES IN THE CENSUS
BUREAU AND WE REFER TO THEM AS UNFORGIVING BUT I’VE SEEN IN
THREE OR FOUR PRESENTATIONS SOME THINGS THAT ARE UNFORGIVABLE AND
THAT’S WHAT IT SAYS.>>WE HAVE UNFORGIVING AND
UNFORGIVABLE DEADLINES BUT WITH THAT I’LL HAND IT BACK OVER TO
AL TO TAKE US BACK.>>THANK YOU, MICHAEL.
I’D LIKE TO THANK EVERYONE BOTH ONLINE AND IN THE ROOM HERE FOR
YOUR ATTENDANCE AT OUR AUGUST 2018 PROGRAM MANAGEMENT REVIEW.
AS WE GO FORWARD WE’LL HAVE MORE DETAIL AND ANALYSIS OF THE
RESULTS OF THE 2018 TEST AS WE GO THROUGH THE NEXT ONE AND ON
OUR PROGRESS IN TERMS OF DEVELOPING PARTNERSHIP
ACTIVITIES AND PLANS FROM OUR COMMUNICATION DIRECTORATE AND
HOW WE REALLY GET TO 2020 AS WE MARCH TOWARDS 2020.
I HAVE TO DIGRESS FOR ONE BRIEF STORY FOR ONE MINUTE IF YOU’LL
JUST TOLERATE ME, IN 2010 IN THE LOS ANGELES AREA WE HAD A CREW
LEADER, A DYNAMITE CREW LEADER.
THERE WAS AN INSTRUMENT WITH A BIOMETRIC LEAD TO LOG ON THAT
WAS A MOSAIC ARTIST AND HER FINGERPRINTS WERE NOT THE SAME
ANY TWO DAYS IN A ROW BECAUSE OF THE ADDITIONAL CUTS FROM BEING A
MOSAIC ARTIST AND ONLY WAY RE —
WE RESOLVED IT WAS HER TOE TO LOG IN.
SHE WAS A GREAT ASSET. WE HAD TO CONTINUE TO USE HER
BUT SHE WAS CONVINCED NO FINGERS WORKED AND IT WAS THE ONLY THING
— HER TOE PRINT DIDN’T CHANGE. BUT THANK YOU ALL.
HAVE A WONDERFUL WEEKEND AND WONDERFUL WEEK.
IF HAVE YOU ANY QUESTIONS, FOLLOW-UP WITH US VIA E-MAIL.
VIA TELEPHONE. WE’LL BE GLAD TO WORK WITH YOU.
THANK YOU VERY MUCH.

Leave a Reply

Your email address will not be published. Required fields are marked *