Writings, Regrets, and Re-skillings during the AI Revolution

Operate, Evaluate, Critique

Before digital literacy became a course title, three older literacy movements were already arguing over what people needed to know. Remember, ‘literacy’ in modernity has come to mean whatever baseline competence is sought to be made mandatory through mass schooling (as discussed in a previous post).

  1. Computer literacy emphasized the ability to operate machines and software.
  2. Information literacy emphasized the ability to evaluate sources and use information intelligently.
  3. Media literacy emphasized the ability to critique messages, representations, institutions, and power.

Those three histories eventually converged under the broad label digital literacy. They did not disappear. A shorthand for the resulting structure is:

Operate. Evaluate. Critique.

This is not an official framework inherited intact from one scholar or organization. It is the historical pattern of contemporary “X-literacy” movements (e.g., AI Literacy, Algorithmic Literacy, etc.) as well as a way of seeing the three older literacy movements still alive and well under the banner of “Digital literacy.”

Operate: The Computer-Literacy Tradition

Computer literacy emerged during the 1970s as computers began moving beyond military, scientific, and corporate specialists.

Its first question was practical:

Can you make the computer do something?

Even that question contained an argument. Some advocates believed ordinary people should learn programming so they could control the machine and use it as a medium for thought. Seymour Papert’s Mindstorms represents this more ambitious tradition.

Fortunately, for most, another version eventually became dominant: learn to operate commercially available software. Open the application. Create the file. Format the document. Enter the formula. Save the work. Print it, attach it, upload it, or share it. This is the tradition I teach most directly in ITE 152. Students use Word, Excel, PowerPoint, file-management tools, communication systems, and other workplace technologies. The work is procedural, but that does not make it trivial. A person who cannot operate the required tools may be locked out of jobs, education, health care, banking, government services, and other ordinary parts of contemporary life.

Operation is real literacy because interfaces regulate access. But operation is also the strand institutions find easiest to teach, observe, and test (SIMnet, anybody?). A student either produced the spreadsheet or did not. The formula works or it does not. The document satisfies the specifications or it does not. That measurability gives operation a structural advantage over the other two verbs.

Evaluate: The Information-Literacy Tradition

Information literacy entered the vocabulary in 1974 to crystallize people’s ability to use information resources to solve problems. Accessing information is not the same as understanding it. Finding a source does not establish that the source is reliable. Receiving an answer does not mean the answer is true. Librarianship later developed information literacy into a broader educational project concerned with searching, comparing sources, assessing authority, tracing claims, and using information ethically. Its central question became:

Should you trust what you find?

Evaluation requires more than spotting obviously fake websites. A source may be accurate but irrelevant. It may be authoritative in one context and inappropriate in another. It may contain valuable evidence while still reflecting the interests, assumptions, and limitations of the institution that produced it.

The Association of College and Research Libraries now describes authority as “constructed and contextual.” That is a considerable distance from a checklist that tells students a .gov source is good and a blog is bad. Evaluation means exercising judgment under conditions where authority is real but never automatic.

Critique: The Media-Literacy Tradition

Media literacy has the oldest of the three lineages. It developed through twentieth-century arguments about propaganda, advertising, popular culture, television, news, and the concentration of communicative power. Its question is not merely whether a message is factually correct. It asks:

What is this message doing—and who benefits?

Who produced it? Who paid for it? What audience does it imagine? What emotions does it activate? Whose experience does it represent? Who is missing? What behavior does the medium encourage? How do ownership, advertising, algorithms, and institutional interests shape what can be said? Evaluation examines a claim. Critique examines the system that made the claim visible, credible, profitable, or difficult to escape.

Media literacy has sometimes been defensive: protect people from propaganda, manipulation, vulgar entertainment, or misinformation. Its more critical traditions go further. They treat audiences as participants who can interpret, challenge, and create media rather than merely receive it. This is the strand most likely to make an institution uncomfortable because the institution itself becomes available for analysis.

Digital Literacy Braids the Three

By the time Paul Gilster published Digital Literacy in 1997, these traditions were already flowing.

A. Computers supplied the operational problem.

B. Networked information supplied the evaluation problem.

C. Digital media supplied the critical problem.

Gilster’s phrase succeeded partly because it was spacious enough to hold all three. Governments, schools, libraries, employers, and technology companies could agree that people needed “digital literacy” without agreeing about what should dominate inside it. That vagueness remains functional.

A software company can use digital literacy to mean product adoption. An employer can use it to mean workplace readiness. A librarian can use it to mean source evaluation. A media scholar can use it to mean understanding platforms, representation, ownership, and power.

Everyone can support digital literacy while imagining a different literacy! The framework becomes a tacit battleground among schemas and metaphors. Operation is easiest to demonstrate. Evaluation is harder because judgment is contextual. Critique is hardest because it questions the purposes and interests of the systems providing the tools. This explains the usual shape of institutional digital literacy. A course may devote weeks to operating applications, a shorter unit to evaluating online information, and perhaps one discussion to privacy, algorithms, labor, ownership, or the political economy of technology.

Three Questions for Any Technology

The triad gives us a simple way to interrogate a curriculum, a competency framework, or a new technology.

A. Operate: Can you use it to accomplish a real task?

B. Evaluate: Can you judge the quality, accuracy, and suitability of what it produces?

C. Critique: Can you examine the interests, assumptions, and power relations built into the system?

Let’s apply this to the latest invented X-literacy: AI Literacy. Operating means writing prompts, supplying context, choosing models, working with files, and incorporating output into a practical workflow. Evaluating means checking claims, testing code, inspecting sources, recognizing hallucinations, and deciding whether the output is suitable for its intended purpose. Critiquing means asking where the training data came from, whose labor supports the system, which languages and perspectives it privileges, who owns the infrastructure, who absorbs its environmental costs, and why an institution wants the technology adopted.

A person can operate an AI system without being able to evaluate its answers. A person can evaluate individual answers without critiquing the system producing them. Each verb reveals a different kind of competence.

Two Triads, Two Purposes

I have previously defined digital literacy as using technology effectively, efficiently, and responsibly. That triad still works. It describes the qualities of competent practice. Operate–evaluate–critique does something different. It describes the historical layers inside the literacy itself.

The two can be combined:

  • Operation should be effective and efficient.
  • Evaluation is necessary for responsible use.
  • Critique expands responsibility beyond the immediate user and task to the institutions, communities, workers, and environments affected by the technology.

One triad asks how well we perform tasks. The other asks how deeply we understand what we are doing.

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *