This is the second post about text mining The Wonderful Wizard of Oz Series. In this post, I am going to focus on just The Wonderful Wizard of Oz.

Common Words

This first set of charts provides a quick look at the most common non-stop words (e.g., the, and, a, etc.) in the book.

It is pretty clear that the character’s names are the most common words in The Wonderful Wizard of Oz. The top seven words are proper nouns (e.g., Dorothy, Scarecrow, Tin Woodman, Lion, Oz, and Witch). One of the interesting things we see looking at the top 20 words, is the common reference to the head, heart, and brains. This makes sense because the Scarecrow has no brains in his head and the Tin Woodman has no heart.

Bigrams

The next set of charts looks at bigrams (i.e., a bigram is a pair of two words that are next to each other in the book).

There are two things that stand out after looking at these graphs.

Proper nouns are the most common bigrams (e.g., Tin Woodman, Wicked Witch, and Emerald City); and There are several bigram clusters.

Since the proper nouns are self-explanatory, I’ll focus on the bigram clusters. Bigrams that include the word Dorothy are all verbs. Bigrams that include the word green are commonly used as an attribute of an object. However, in the case of the green girl, it is both an attribute and used in the book to refer to a specific person known only as the “green girl”.

The last cluster includes the words winged, monkey(s), king, crow, and flew. This is a little different than the previous two clusters. Winged monkeys, and the monkey king, were sent by the Wicked Witch to capture Dorothy and destroy her friends. The Wicked Witch also sends King Crow with other crows to “Fly at once to the strangers; peck out their eyes and tear them to pieces.” The commonality between the winged monkeys and the crows was they were both used by the Wicked Witch to attack Dorothy.

Sentiment Analysis

The last chart is a sentiment analysis of The Wonderful Wizard of Oz. A sentiment analysis provides a general feeling of the overall data. In this case, the chart is broken up into the book’s pages and shows the per page sentiment (e.g., positive words – negative words = page score).

There are two things that stand out from the sentiment analysis:

Overall, The Wonderful Wizard of Oz is fairly positive; and Negative pages often form clusters.

Here is a brief overview of the book as viewed through the sentiment analysis.

Section A

Dorothy first arrives in Oz and travels to the Emerald City.

The initial negative pages reflect her desire to return home, while the positive pages highlight moments where she finds help (e.g., Munchkins, Scarecrow, Tin Woodman, Lion, etc.).

The first negative page cluster, pages 20-30, includes a moment when Dorothy and her new friends are being chased by Kalidahs. Since Kalidahs don’t appear in the movie, here is the Lion’s description of the Kalidahs: *”They are monstrous beasts with bodies like bears and heads like tigers,” replied the Lion, “and with claws so long and sharp that they could tear me in two as easily as I could kill Toto. I’m terribly afraid of the Kalidahs.”

This section ends with Dorothy and her friends getting caught in the poppy field, escaping the poppy field, and reaching the Emerald City.

Section B

Dorothy and her friends enter the Emerald City and meet the Wizard of Oz.

The positive pages reflect the wonder and excitement of being in the Emerald City and preparing to meet the Wizard of Oz.

The negative page reflects the Wizard’s response that he will only help them if they kill the Wicked Witch.

Section C

Dorothy and her friends begin their journey to destroy the Wicked Witch.

This is the second negative page cluster, pages 49-57. The two main events take place in these pages: Dorothy and her friends are attacked by the Wicked Witch’s minions and Dorothy is capture; and Dorothy is enslaved until she kills the Wicked Witch.



Section D

Dorothy and the Wizard of Oz prepare to return to Kansas.

Most of this include positive pages because the Wizard of Oz keeps his promise to help Dorothy and her friends. The Wizard provides Scarecrow brains, Tin Woodman a heart, and Lion courage. The Wizard also makes plans to take a hot air balloon with himself and Dorothy back to Kansas.

The two negative pages reflect the moment when Dorothy and her friends realize the Wizard of Oz is a “humbug”.

While still positive, the last few pages in this section dip down because Dorothy was unable to get into the hot air balloon in time and is stranded in Oz while the Wizard flies away.

Section E

Dorothy travels to Glinda the Good Witch.