Information Sources

Liam: I know a lot about the topic, can I reference myself?

William: Can I use Wikipedia as a source?

Jacob: How do I reference some information I saw on social media?

Hunter: Can I reference my textbook? What about the course notes?

— Students wondering what information sources to use

Students new to university are often confused about what information sources they can use for their assignments. At high school, they may have used Google and just taken information from the first few search results. Although every assignment is a bit different, it is generally expected that the student uses scholarly as opposed to popular sources.

Scholarly source usually means a research article published in a peer-reviewed journal. It can also mean books that are authored by an expert in the subject, peer-reviewed, and published by a university press (like Oxford University Press). In one sense, every non-scholarly source can be considered a popular source. There is also the category of trade publications. These are non-academic publications aimed at professionals in a certain industry. Trade publications focus on industry news, technologies, trends, and more informal articles.

Within the popular category, some sources are more reliable than others. For example, Newsweek or the New York Times are more reliable than tabloid magazines that focus on celebrity gossip. Depending on the topic, it may be appropriate to have some combination of scholarly and popular sources. Also, popular sources may be the object of analysis, for instance, you might be writing an essay on how the media covers an election. If you are unsure, check with academic staff what their expectations are.

Tip
Stick to scholarly sources of information unless the assignment specifically requires using popular sources.

If in doubt about whether an information source is scholarly or popular, the following table provides some guidance:

Table 1. Popular versus scholarly information sources

Popular

Scholarly

Citations

Rarely cites sources. May attribute informally in text.

Many sources cited following a particular academic style.

Review Process

Not peer reviewed.

Usually peer reviewed.

Audience

General public

Scholars, researchers, experts

Authors

Journalists, professional writers, bloggers

Scholars and experts in the field

Length

Articles are shorter and more general

Longer articles, more depth and narrower scope.

Format

Varies

Includes abstract, method, results, conclusion

Language

Non-technical. No specialist knowledge assumed.

Technical language. Specialised vocab. Dense.

Appearance

Photos, illustrations, colourful

Mostly text. A few tables and charts. Usually not in colour.

Original Research

No original research

Original research

Purpose

To inform and entertain

Present cutting-edge research

Title

May include words like "Journal", "proceedings"

Examples

Vogue, Sports Illustrated, Time, Reader’s Digest, newspapers, cnn.com

Journal of Applied Psychology, British Medical Journal

Peer-reviewed

One of the main factors that distinguishes scholarly from popular sources is that scholarly sources are peer-reviewed. Peer-reviewed means other scholars in the same field have reviewed the material before it is published. They may suggest revisions or even reject it entirely. Almost every prestigious academic journal is peer-reviewed. There are a number of reasons why peer-reviewed articles are considered superior:

  • Prevents poor quality or misleading research from being published.

  • Detects flaws in the methodology.

  • Highlights any gaps in the literature review.

Although the process varies depending on publisher, books published by academic presses such as monographs or edited volumes also undergo a form of peer review.

Some assignments may require that you only use peer reviewed papers as references. Academic search engines such as Google Scholar often provide a filter to only return peer reviewed papers.

Wikipedia

Wikipedia is one of the most popular sources of information for the general public, and has many quality articles on a diverse range of topics. The fact that anyone can create or edit articles means that it isn’t regarded as a scholarly source. Another issue is that wikipedia articles are constantly changing. It is generally safe to use wikipedia as an introduction to a subject and as a way to identify primary sources of information, but don’t cite it directly. In other words, Wikipedia is mostly useful for background information and as a pointer to other sources.

Tip
Wikipedia articles are often of good quality but don’t count as a scholarly source.

Textbooks and course notes

It pays to check with your university, but at most universities it is acceptable to use a textbook as a reference for introductory undergraduate courses. Although the textbook may not necessarily incorporate the latest research, and are not typically peer-reviewed in exactly the same way journal articles are, they are still written by experts in the field and nearly always reviewed by other academics. Thus, they are regarded as scholarly enough for some undergraduate assignment purposes. For higher level undergraduate courses, check with your instructor before citing your textbook in an assignment, it could be expected that you will rely exclusively on the primary literature.

Generally, course notes should not be used as a reference. These have not been reviewed in the same way that a journal article, scholarly book, or textbook has. In addition, course notes are often abbreviated and lack the level of detail needed for a written assignment. The person who created the course notes likely just copied them from a textbook anyway which could be referred to instead. In many cases, when academics adopt a particular textbook, the publisher provides them with resources such as slides and other materials to use. It makes more sense to directly reference the sources that the lecturer has used.

Tip
As an undergraduate, and especially in your first year, it is usually fine to reference textbooks.

Academic databases

The best way to locate scholarly sources is to use an academic search engine (academic research database) like Google Scholar. In many cases, Google Scholar will include not just the author, title, abstract, and other metadata, but also a link to the full article. In some cases the article will be behind a paywall. If so, check if your university has a subscription to that journal, which will allow access through the library website.

Another useful feature of Google Scholar is its cited by feature which indicates how many times a journal article has been cited. For many undergraduate assignments, this is an adequate metric to identify some of the more influential and important articles.

Research databases will be more reliable than a typical search engine in that they only index credible resources. Research databases offer various filtering options such only returning "peer-reviewed" or more recent works. As mentioned earlier, peer-reviewed means the article was scrutinised by subject-matter experts before publication. This increases the accuracy and credibility of the content.

There are many competing search engines, both free and paid, some of which cover all subjects and others which focus on specific areas.

A selection of academic research databases
  • Google Scholar

  • Scopus (subscription only)

  • Web of Science (subscription only)

  • PubMed (medical and bioscience resources)

  • PsychINFO (subscription only, focuses on psychology)

  • IEEE Xplore (computer science and electrical engineering)

Tip
Familiarise yourself with academic research databases before you need them for an assignment.

TRAAP test

For some assessments, you might need to use sources other than those published in prestigious academic journals. One test for evaluating any source is the TRAAP test. This was created by the Australian National University (ANU) based on an earlier test created by a team at California State University’s Meriam library in 2004 (the so called C.R.A.A.P test) [1].

  • Timeliness: How recently was the information published? Has it been refuted or updated?

  • Relevance: How relevant is the source? Are there better sources?

  • Authority: Who created the information? What are their credentials? Are they trustworthy?

  • Accuracy: Is it peer-reviewed? Can the information be verified? What evidence is provided?

  • Purpose: Is the information objective? Was it created with some agenda?

Currently there is a proliferation of misinformation and disinformation online. Some bad actors are extremely sophisticated at propagating deliberately fake information. Traditional tools like TRAAP may not be adequate for detecting this kind of deception. One study found university students struggled to identify that a story from a satirical news site was not actually real. In addition, students couldn’t determine that a supposedly objective website about minimum wage laws had actually been created by a public relations firm with funding from those opposed to increases in the minimum wage [2].

Methods like TRAAP / CRAAP encourage a deep dive into a given site to assess its credibility, whereas a lateral fact checking approach may be more suitable. This means a site needs to be assessed by looking for information outside the site in order to determine who is behind the site and what agenda may exist [3, 4].

SIFT

Another approach useful for evaluating web sources is SIFT. This was developed by Mike Caulfield and consists of the following steps [5]:

  • Stop. The purpose of the stop step is to remind you not to read the article until you fully understand who wrote the article, why they wrote it, and what their agenda might be.

  • Investigate the source. This means know the origin of what you are reading and how trustworthy it is. Who wrote it and what is their expertise? Do they have a good reputation or a history of spreading misinformation? Does the author even exist?

  • Find better coverage. Once we understand the claim an article is making, check whether there exists a better, more indepth, and more reliable source. At a minimum, consult several sources and see if there is a consensus.

  • Trace claims, quotes and media to the original context. This means go back to the original source. Some articles can strip important context or inaccurately represent the results of research or studies.

Summary

In academic writing the most common source will be scholarly journals. However, books that are scholarly in nature are also acceptable sources. Textbooks are sometimes an acceptable source, especially for introductory courses. Always check with your lecturer or tutor if in doubt, as sometimes rules can vary from course to course.

Be cautious about using popular sources of information. There is a lot of unreliable and inaccurate information on the web. Any sources need to be checked using tools like SIFT and TRAAP.

References

[1] S. Blakeslee, “The CRAAP test,” Loex Quarterly, vol. 31, no. 3, p. 4, 2004.

[2] S. Wineburg, J. Breakstone, N. Ziv, and M. Smith, “Educating for misunderstanding: How approaches to teaching digital literacy make students susceptible to scammers, rogues, bad actors, and hate mongers,” Stanford History Education Group Working Paper No. A-21322). Retrieved March, vol. 2, p. 2021, 2020.

[3] J. A. Fielding, “Rethinking CRAAP: Getting students thinking like fact-checkers in evaluating web sources,” College & Research Libraries News, vol. 80, no. 11, p. 620, 2019.

[4] S. Wineburg and S. McGrew, “Lateral reading and the nature of expertise: Reading less and learning more when evaluating digital information,” Teachers College Record, vol. 121, no. 11, pp. 1–40, 2019.

[5] “SIFT (The Four Moves).” https://hapgood.us/2019/06/19/sift-the-four-moves/ .