SEO Article Writing Experiment: AI vs Human

Published at Oct 9, 2023 | Last updated at Dec 30, 2024
SEO Article Writing Experiment: AI vs Human Image Cover

The spread of AI (Artificial Intelligence) articles has led to a growing belief that human intervention is no longer necessary in SEO content writing. This news has spread worldwide and raised concerns among content writers. However, it's important to note that this statement remains unproven, yet can not be entirely denied.

ChatGPT, a prominent AI model, has explicitly stated that its purpose isn't to replace human writers but to assist them throughout the content creation process.

Figure 1: The response from ChatGPT when we ask about AI's goal in potentially replacing human content creators.

A number of SEO practitioners have undertaken case studies on this subject, with varying results. Some indicate that AI-generated SEO content has positive SEO outcomes, while others report the opposite.

Figure 2: AI-generated content displayed positive effects in a study conducted by Nathan Gotch, but exhibited negative effects in research conducted by Glenn Gabe and Reboot.

Given this background, cmlabs decided to conduct a similar experiment comparing the performance of AI-written and human-written SEO articles on Google search results pages using keyword rank metrics.

The main objective of this experiment is to determine whether articles written by AI can achieve higher rankings on Google compared to articles written by humans.

This experiment took place over two months. The first month was used by the SEO and Content Writer team to research keywords and produce articles, and the following month was allocated for the SEO and data teams to track the ranking of each keyword and analyze its progress.

After conducting this experiment, additional data was obtained to support the experiment's findings. The following are the stages of the experiment we conducted.

Stages of the AI vs. Human Experiment

All stages in this experiment were conducted fairly, with no differentiation or special treatment given to articles written by humans or AI. We applied the same guidelines to both types of content to avoid factors that could influence the performance of specific content.

1. Websites Selection

In this experiment, we chose six websites, each of which already had different levels of content assets and organic traffic. These websites were tiketresmi.com, museumnusantara.com, inklusiuang.com, animalogi.com, teknohacks.com, and bundatimes.com.

Each website would later publish five SEO articles written by humans and five SEO articles written by AI, all with topics related to the website's niche.

2. Keyword Research

The SEO team used third-party SEO tools such as Google Keyword Planner, Semrush, and Sequence Keyword Research Tool to conduct keyword research. This step is critical because each keyword has its own competitive level that can impact its ranking on Google.

To ensure that all keywords, both for AI-generated articles and human content had an equal level of competition, we followed the following guidelines:

  • Keyword selection is aligned with each website's niche.
  • All keywords had an "informational" search intent.
  • The search volume for the chosen keywords had similar gaps.
  • All keywords had a "low" level of competition.
  • We ensured that none of the selected keywords had previously been used in articles on the respective websites.

Here is the list of keywords used in this experiment:

Websites

Writers

Keywords

tiketresmi.comHumantravel pekanbaru dumai
Humantravel kediri surabaya
Humanbus doa ibu
Humanbus pangeran
Humanbus sahabat
AItravel bandung cirebon
AIbus gumarang jaya
AIbus dewi sri
AIbus madu kismo
AIbus epa star
museumnusantara.comHumansejarah tari sirih kuning
Humanbusana tari tor tor
Humantata busana tari kecak
Humantari topeng sidakarya
Humantari malemang
AIbusana pranakan
AIgitar dambus
AIbentuk busur panah
AIbusana sikepan
AIbusana surjan
inklusiuang.comHumanhigh risk artinya
Humannet working capital adalah
Humanlate charge adalah
Humanmetode penilaian investasi
Humanaset tidak berwujud adalah
AIapa itu perusahaan pialang
AIapa itu golden cross saham
AIcara tebus right issue
AIpullback trading
AIapa itu tp
animalogi.comHumansogok ontong
Humanmakanan burung kutilang
Humanmakanan ikan sepat
Humanjenis burung kecil
Humanjenis ular sawah
AIburung kedasih
AIjenis bunglon
AIjenis musang
AIciri ciri hamster hamil
AImakanan kesukaan katak
teknohacks.comHumanemmc adalah
Humanapa itu wireless
Humannoc adalah
Humancontoh cyber crime
Humansegmentasi targeting positioning
AIubah latar belakang foto online
AIcara scan dokumen di hp
AIwifi 6
AIjaringan nirkabel
AIpengertian wan
bundatimes.comHumansusu uht yang bagus untuk anak 2 tahun
Humanpasang behel anak
Humanareola ada bintik bintik tanda hamil
Humanasi berwarna kuning dan berminyak
Humanmanfaat daun miana
AIanak muntah dan mencret
AImakanan pasca operasi
AIsusu uht untuk anak usia berapa
AIbahaya susu uht untuk balita
AIsusu almond ibu menyusui



 

3. AI Selection

The launch of ChatGPT by OpenAI has captured the attention of a wide audience. Although ChatGPT is not the first AI of its kind, since its release on November 30, 2022, it has prompted various platforms to compete in providing features supported by ChatGPT or AI-based solutions.

In our case, we have opted to utilize ChatGPT through a Chrome extension known as AIPRM for ChatGPT. Additionally, we have used several available prompt templates within this extension. Our primary objective is to ensure that all AI-generated articles remain consistent in quality, thereby preventing biases and disparities among AI-generated articles, which could impact their performance in Google rankings.

Furthermore, we conducted preliminary testing of these prompt templates to produce an article using the "informational" keyword and compared it with articles featuring the same keyword on the Search Engine Results Page (SERP). The results indicated that the AI-generated article using the prompt template contained information similar to that found in the articles we encountered on the SERP. Therefore, it can be concluded that the prompt template is suitable for this AI vs. Human writing experiment.

4. Content Creation and Publication

The purpose of this experiment is to assess the performance of articles written by AI in comparison to those written by humans on the SERP. To achieve this, we have minimized or avoided any human intervention in the production of AI-generated articles. However, it is essential to ensure that all articles adhere to the same guidelines for consistent optimization.

Here are the guidelines for the creation of all articles:

  • Use only one primary keyword.
  • Maintain a minimum word count of 500 for each article.
  • Include the primary keyword in the meta-information and the introduction of the article.
  • Incorporate a minimum of one internal link.

In addition, there are supplementary guidelines to be followed for AI articles:

  • Write articles using the prompt template "Human Written | 100% Unique | SEO Optimized Article," including the introduction, headings, and closing.
  • Create meta-information using the prompt template “Title + Meta description + 10 Hn tags.”

Furthermore, for the article cover images in both human and AI articles, we use licensed images downloaded from stock image providers.

Once 30 AI articles and 30 human articles have been produced, we proceed with their publication on the respective websites.

Websites

Writers

Keywords

URL

tiketresmi.comHumantravel pekanbaru dumaihttps://tiketresmi.com/travel-pekanbaru-dumai/
Humantravel kediri surabayahttps://tiketresmi.com/travel-kediri-surabaya/
Humanbus doa ibuhttps://tiketresmi.com/bus-doa-ibu/
Humanbus pangeranhttps://tiketresmi.com/bus-pangeran/
Humanbus sahabathttps://tiketresmi.com/bus-sahabat/
AItravel bandung cirebonhttps://tiketresmi.com/travel-bandung-cirebon/
AIbus gumarang jayahttps://tiketresmi.com/bus-gumarang-jaya/
AIbus dewi srihttps://tiketresmi.com/bus-dewi-sri/
AIbus madu kismohttps://tiketresmi.com/bus-madu-kismo/
AIbus epa starhttps://tiketresmi.com/bus-epa-star/
museumnusantara.comHumansejarah tari sirih kuninghttps://museumnusantara.com/sejarah-tari-sirih-kuning/
Humanbusana tari tor torhttps://museumnusantara.com/busana-tari-tor-tor/
Humantata busana tari kecakhttps://museumnusantara.com/tata-busana-tari-kecak/
Humantari topeng sidakaryahttps://museumnusantara.com/tari-topeng-sidakarya/
Humantari malemanghttps://museumnusantara.com/tari-malemang/
AIbusana pranakanhttps://museumnusantara.com/busana-pranakan/
AIgitar dambushttps://museumnusantara.com/gitar-dambus/
AIbentuk busur panahhttps://museumnusantara.com/bentuk-busur-panah/
AIbusana sikepanhttps://museumnusantara.com/busana-sikepan/
AIbusana surjanhttps://museumnusantara.com/busana-surjan/
inklusiuang.comHumanhigh risk artinyahttps://inklusiuang.com/high-risk-artinya/
Humannet working capital adalahhttps://inklusiuang.com/net-working-capital-adalah/
Humanlate charge adalahhttps://inklusiuang.com/late-charge-adalah/
Humanmetode penilaian investasihttps://inklusiuang.com/metode-penilaian-investasi/
Humanaset tidak berwujud adalahhttps://inklusiuang.com/aset-tidak-berwujud-adalah/
AIapa itu perusahaan pialanghttps://inklusiuang.com/apa-itu-perusahaan-pialang/
AIapa itu golden cross sahamhttps://inklusiuang.com/apa-itu-golden/blog/p>
Blog Card

cmlabs

Thank you for taking the time to read my article! At cmlabs, we regularly publish new and insightful articles related to SEO almost every week. So, you'll always get the latest information on the topics you're interested in. If you really enjoy the content on cmlabs, you can subscribe to our email newsletter By subscribing, you'll receive updates directly in your inbox. And hey, if you're interested in becoming a writer at cmlabs, don't worry! You can find more information. here So, come join the cmlabs community and stay updated on the latest SEO developments with us!

WDYT, you like my article?

Subscribe to Our Newsletter

Enter your email to receive news from us

SEO Services
SEO Content Writing
Expert Writing
Media Buying