Instructions for Observing Pre-election Voting Machine Tests

Purpose of the Pre-election Machine Test

New instructions have to be loaded into each voting machine before each election so that it can record and count votes for that election’s unique set of races and candidates.  But whenever new programming is loaded into any computer, opportunities for error arise.

Pre-election testing is intended to detect machine malfunctions and programming errors in time to fix them before Election Day.

Pre-election tests can detect most accidental mis-programming, but not deliberate hacking because skillful programmers would know not to allow their hacks to manipulate vote totals before Election Day. 

In addition, clerks sometimes use pre-election voting-machine tests for training new poll workers in how to operate the machines.

What happens at a pre-election voting machine test?

The Wisconsin Government Accountability Board (GAB) has prepared a seven-minute video showing a voting-machine test. This test can be performed by the municipal elections clerk or someone that he or she designates.  Before the test, the municipal clerk prepares a “test deck”, a set of marked ballots or a series of votes to be entered into the touch-screen machine, with a predetermined correct result.

The voting machine will be set up just as it will be on Election Day and turned on. The clerk will run a ‘zero tape’ to make sure that no votes are stored in the machine’s memory. 

Someone then feeds the ballots through the optical scanner, or two people will enter them into the touch-screen machine. (Two people are needed to test the votes on the touch-screen to make sure the votes are cast as planned.)  

The machine will be shut down using the same procedure that will be used at poll closing on Election Day. The results will be printed out and compared to the expected results. If the machine produces different results than the clerk expected, the clerk must determine what caused the discrepancy and correct it.

Purposes of observing

Without observers, the clerk is unable to demonstrate to the public that the voting machines have been set up correctly. If something goes wrong on Election Day and no observers were present at the test, the clerk might be suspected of having done the test carelessly or not at all.

The mere presence of observers—even if they say nothing—helps to ensure the tests are performed thoroughly and in accordance with instructions. If the machine does not produce results that match the pre-determined results, the presence of citizen observers helps to ensure that the problems are adequately addressed.

In addition, conscientious clerks welcome public observers because they know that citizen observers can help them build a good reputation and confidence in well-run elections.

Finally, because voting machine tests are often relatively relaxed, unhurried occasions, they provide a good opportunity for citizens to get to know the municipality’s election equipment and procedures better, and to allow the municipal clerk and interested citizens to get to know each other and develop mutual respect for their shared interest in accurate election results.   

What should observers do and what should they watch for?

1.   Call your municipal clerk about two weeks before the election to ask when and where the voting-machine test(s) will take place.  By law, the tests cannot take place any earlier than 10 days before the election.
Tell the clerk you are interested in observing the test, and say that you understand they will be following the instructions that start on page 139 of the Election Administration Manual, and ask if he or she will be following any other instructions, such as from the county clerk or the machine vendor, so that you will know what to expect.

Specifically mentioning the GAB instructions reassures the clerk that you have realistic expectations and will give him or her opportunity to refresh his or her memory about those instructions before the test. 

2.   Bring a copy of the relevant sections of the statute and the instructions from the Election Administration Manual (both are below) so that you can refer to them as the test proceeds.  Read them ahead of time; they are not difficult.

4.   Arrive early or on time so that you can observe the machines being set up, if they were not set up ahead of time. This may not go quickly and smoothly if the testers are still learning how to set the machines up.  Their set-up efforts, however, should end with a voting machine that is operating correctly and has printed out a tape showing that no votes are stored in the computer’s memory.

5.   Ask to see the test deck and the predetermined results, and ask the clerk to show you how the test deck conforms with the statute and the instructions from the Election Administration Manual. See the starred items (*) below.

An issue you should know about: GAB's written instructions for the test (unlike the video) neglect to tell the clerk that the test deck should contain a different number of votes for each candidate (no ties), although this is essential if the test is going to be able to detect what is likely the most common set-up error: 'flipping' the votes--that is, accidentally instructing the machine to count Jones' votes for Smith, and Smith's votes for Jones. Every clerk understands the necessity of this once it is pointed out to them, so if your clerk has created a test deck giving candidates in any contest the same number of votes as another candidate, ask him or her to create one more ballot that breaks all the ties.

No instructions specify how large the test deck should be, and many clerks do not understand that some errors cannot be detected in very small tests. For example, several elections were ruined in California by a programming error that made the machine ‘zero out’ after the first 100 ballots and start the count from zero again at the 101st ballot. If your clerk uses a very small test deck (10 or less is very common), suggest that he or she look into the wisdom and feasibility of running a larger test in subsequent elections.

6.  Ask questions throughout the process, as long as your questions don’t interfere with the purpose of the test or slow the test down more than the officials are willing to accommodate your questions.
For tests of touch-screen machines: Although it is not required by the prescribed instructions, ask the clerk if he or she will have the testers deliberately cast at least one vote for the wrong candidate and correct the error only after the paper trail has been printed. This required feature has been known to malfunction, and a clerk would be wise to test it before Election Day.

7.   When the test ballots have all been cast and the results printed out, the clerk will compare the results tabulated by the machine to the predetermined results he or she prepared ahead of time. The clerk should allow you to see, if not handle, the documents so that you, as an independent observer, can confirm that the results are the same.
For tests of touch-screen machines: Although it is not required by the prescribed instructions, ask the clerk if he or she will verify that the voter-verifiable paper trail (VVPAT) printed correctly. Elections have been threatened or ruined by malfunctioning VVPAT mechanisms, election officials inserting the paper the wrong way, and other problems. It is important that these be verified as functional; if they are not working correctly, a verifiable record of the votes may not be created on Election Day.

8.  If the machine-tabulated results don’t agree with the predetermined results, the clerk needs to figure out what the problem is. The clerk may conclude that the machine is correct and his or her predetermined results were in error. For example, the clerk might decide he or she was mistaken about the color of ink the machine is able to read, or how overvotes or undervotes were to be processed. If this is the case, discuss the issue and try to discourage the clerk from merely assuming the discrepancy was caused by his or her error without checking.

An issue you should know about: Unless your county clerk has provided your municipal clerk with additional instructions, he or she will have no instructions to follow if the two counts cannot be reconciled. Nevertheless, if this happens, expect the municipal clerk promptly to notify the county clerk of the problem. Observers should follow up with both county and municipal clerk to make sure that the machines are used on Election Day have produced an errorless count, in this municipality and elsewhere in the county, as required by statute.

What to do if you see problems

If you see any practices that don’t match the instructions, ask the clerk to explain. There may be some necessary, harmless variations the clerk is doing for a sensible reason. As long as the main purpose of the test is fulfilled—a public demonstration of an errorless count—there’s no need for observers to be sticklers.

If the clerk cannot give you a good explanation for the variation, and you think the variation prevents the test from demonstrating an errorless count, refer the clerk to the precise requirement or instruction that you believe is not being followed. Explain the reason for your concern.

For example, if the machine-tabulated results do not match the predetermined results, a clerk might call an end to the test, saying that he or she will return to the office and figure out the problem.  If this happens, you could say something like, "Determining whether the machine has produced an errorless count is part of the test, and statutes say the test needs to be open to the public. If you return to your office to figure out and fix the problem, how and when will you perform the errorless count in a public test?”

Try to work something out with the clerk that meets both his or her needs and your own need to observe an errorless count, always keeping your demands centered on the statutory requirements and the Election Administration Manual instructions.

If you cannot work out a mutually satisfactory resolution with the municipal clerk, encourage him or her to contact the county clerk about the matter, and say you will do the same.  Write down the relevant details of the problem promptly, clearly, factually, and completely. Then call or email the county clerk to report the problem and ask to be kept informed as the problem is resolved.

If the problem is not resolved by early afternoon on the Friday before the election, contact the Elections Division of the Wisconsin Government Accountability Board, before the close of business that day if at all possible, to give GAB staff at least one working day before Election Day to respond. GAB can be reached by phone at (608) 266-8005, or email at gab@wi.gov. Consider completing a complaint form (gab.wi.gov/forms/complaint ), and faxing it to GAB at (608) 267-0500.

*  *  *  *  *

Excerpt from Wisconsin State Statutes:

Pre-Election Voting-Machine Testing (Paragraph breaks added.)

5.84 Testing of equipment; requirements for programs and ballots.

 (1) Where any municipality employs an electronic voting system which utilizes automatic tabulating equipment, either at the polling place or at a central counting location, the municipal clerk shall, on any day not more than 10 days prior to the election day on which the equipment is to be utilized, have the equipment tested to ascertain that it will correctly count the votes cast for all offices and on all measures.

Public notice of the time and place of the test shall be given by the clerk at least 48 hours prior to the test by publication of a class 1 notice under ch. 985 in one or more newspapers published within the municipality if a newspaper is published therein, otherwise in a newspaper of general circulation therein.

The test shall be open to the public.

The test shall be conducted by processing a preaudited group of ballots so marked as to record a predetermined number of valid votes for each candidate and on each referendum.

* The test shall include for each office one or more ballots which have votes in excess of the number allowed by law and, for a partisan primary election, one or more ballots which have votes cast for candidates of more than one recognized political party, in order to test the ability of the automatic tabulating equipment to reject such votes.

 If any error is detected, the municipal clerk shall ascertain the cause and correct the error.
The clerk shall make an errorless count before the automatic tabulating equipment is approved by the clerk for use in the election.

 (2) Before beginning the ballot count at each polling place or at the central counting location, the election officials shall witness a test of the automatic tabulating equipment by engaging the printing mechanism and securing a printed result showing a zero count for every candidate and referendum. After the completion of the count, the ballots and programs used shall be sealed and retained under the custody of the municipal clerk in a secure location.

 History: 1979 c. 311; 2001 a. 16; 2005 a. 92.

* Indicates required or recommended features of the test deck (optical scan) or voting plan  (touchscreen).

 *  *  *  *  *

Excerpt from Election Administration Manual (page 139-141):

         Pre-Election Electronic Voting Equipment Testing
Wisconsin statutes require that all municipalities test the software of electronic voting equipment for correctness and accuracy. The purpose of testing electronic voting equipment is to ensure that the equipment will correctly tabulate votes for all offices and referenda.
Public Notice
The testing of electronic voting equipment, either DRE or optical scan equipment, shall be open to the public.
1. The test may not be conducted earlier than ten days before Election Day.
2. Public notice of the time and location of the testing shall be given by the clerk at least 48 hours before.
Procedure
In order to conduct a pre-election test for accuracy, the municipal clerk must create a test deck, which is a plan detailing a predetermined number of valid votes for each candidate and on each referendum.The test deck should reflect all of the required testing components described in this section.
1. Optical Scan Equipment    
a.   Ballots should be marked to reflect a pre-determined number of valid votes for each candidate and referendum.    
b.   Pre-marked ballots shall be run through the optical scan voting unit.    
c.    The actual tabulation of the pre-marked ballots shall then be compared to the pre-determined number to verify the voting equipment is tabulating properly.
2. Direct Recording Electronic (DRE) Equipment    
a.    Votes shall be cast on the DRE unit in a manner reflecting a pre-determined number of valid votes for each candidate and referendum.    
b.    The printout of the tabulation of the votes cast shall then be compared to the pre-determined number to verify the voting equipment is tabulating properly.   
c.     At least two individuals should participate in the DRE test to ensure votes selected on the test deck are entered correctly in the voting system.

3. Errorless Count Requirement

a.    If an error is detected during the testing, the municipal clerk shall determine the cause and correct the error.

b.    The clerk must make an errorless count before the electronic tabulating equipment is approved by the clerk for use in the election. 

« Note: The G.A.B. recommends that municipalities formulate a test deck that is unique to the municipality, and refrain from using test decks provided by the manufacturer/programmer. This is to ensure any errors not discovered by the programmer will be uncovered by the clerk during the test. 
Testing Components Requirement
*  1.       Each candidate for every office, for every party, needs to be tested.
*  2.       Overvotes need to be tested for every office and ballot measure on the ballot.
a.    Overvotes are votes in excess of the number allowed by law.
b.    Overvotes shall be rejected by the voting equipment.
*  3.       Blank Ballots
a.    Blank ballots are ballots that have no votes recorded.
b.    A blank ballot shall be tested to ensure that they are rejected by the voting equipment and notify the elector that no votes have been recorded.
*  4.       Write-in votes
a.    On DRE equipment, the write-in function for each office shall be tested to ascertain that it is functioning properly.
b.    On optical scan voting equipment, it shall be tested to determine that ballots containing write-in votes for each office are properly separated into the write-in bin.
*  5.       Partisan Primary
The clerk shall test for one or more ballots that have votes cast for a candidate of more than one recognized party are rejected.
*  6. General Election
Straight party voting is only allowed for military and overseas voters on write-in absentee ballots.
Note: Straight party ballots may also be remade by election inspectors on Election Day in order to be tabulated by voting equipment or may be counted by hand. 

*  Indicates required or recommended features of the test deck (optical scan) or voting plan (touchscreen).

 

- - - - - - - - - - -

A printable pdf version is this document is availabe through a link on this page.

These instructions can be improved by your feedback. Please comment below or email your suggestions to us at wisconsingrassroots@gmail.com. We particularly invite suggestions from observers who have used these instruction at a voting machine test, and from election officials.

Let us know how your experience went, and what you saw, either good or bad, by emailing us at wisconsingrassroots@gmail.com.

 

For updates, follow Wisconsin Election Integrity on Facebook.