Initial commit

.idea/.gitignore

+# Default ignored files
+/workspace.xml
\ No newline at end of file

.idea/Part3.iml

+<?xml version="1.0" encoding="UTF-8"?>
+<module type="PYTHON_MODULE" version="4">
+  <component name="NewModuleRootManager">
+    <content url="file://$MODULE_DIR$" />
+    <orderEntry type="inheritedJdk" />
+    <orderEntry type="sourceFolder" forTests="false" />
+  </component>
+  <component name="TestRunnerService">
+    <option name="PROJECT_TEST_RUNNER" value="Unittests" />
+  </component>
+</module>
\ No newline at end of file

.idea/dictionaries/marcfeger.xml

+<component name="ProjectDictionaryState">
+  <dictionary name="marcfeger">
+    <words>
+      <w>dataframe</w>
+    </words>
+  </dictionary>
+</component>
\ No newline at end of file

.idea/inspectionProfiles/profiles_settings.xml

+<component name="InspectionProjectProfileManager">
+  <settings>
+    <option name="USE_PROJECT_PROFILE" value="false" />
+    <version value="1.0" />
+  </settings>
+</component>
\ No newline at end of file

.idea/misc.xml

+<?xml version="1.0" encoding="UTF-8"?>
+<project version="4">
+  <component name="JavaScriptSettings">
+    <option name="languageLevel" value="ES6" />
+  </component>
+  <component name="ProjectRootManager" version="2" project-jdk-name="Python 3.7 (arguments)" project-jdk-type="Python SDK" />
+</project>
\ No newline at end of file

.idea/modules.xml

+<?xml version="1.0" encoding="UTF-8"?>
+<project version="4">
+  <component name="ProjectModuleManager">
+    <modules>
+      <module fileurl="file://$PROJECT_DIR$/.idea/Part3.iml" filepath="$PROJECT_DIR$/.idea/Part3.iml" />
+    </modules>
+  </component>
+</project>
\ No newline at end of file

example.csv

+item,rating1,rating2,rating3
+1   ,1      ,3      ,1
+2   ,2      ,2      ,2
+3   ,3      ,3      ,3
+4   ,1      ,1      ,3
+5   ,1      ,2      ,3
\ No newline at end of file

krippendorff.py

+import sys
+from collections import Counter
+
+import pandas as pd
+
+
+def generate_reliability_matrix(of: pd.DataFrame) -> pd.DataFrame:
+    """
+    This function generates the reliability matrix. For this it takes all column names which starts with rating.
+    Then it cuts out the rating matrix which is equivalent to the reliability matrix
+
+    :param of: Dataframe of which the reliability matrix should be generated
+    :return: Reliability-Matrix were rows represent the units and columns the annotator.
+    """
+    rating_columns = [x for x in of.keys() if x.startswith("rating")]
+    return of[rating_columns]
+
+
+def generate_categories(of: pd.DataFrame) -> set:
+    """
+    This function take the reliability matrix. Then it will flatt the values and takes the set over all values.
+    This is for getting all unique values given in the ratings.
+
+    :param of: Reliability-Matrix where the unique values should be taken from.
+    :return: Set of unique elements which were used for ratings.
+    """
+    return set(of.values.flatten())
+
+
+def generate_coincidence_matrix(of: pd.DataFrame, together_with: set) -> dict:
+    """
+    This matrix generates the coincidence-matrix of the reliability-matrix together with all categories.
+    This is done by iterating over all unity and applying the formula for o_ck on foil 59 of lecture 4.6.
+
+    :param of: Reliability-Matrix where the coincidence-matrix should be generated from
+    :param together_with: Categories which were used for annotation
+    :return: Coincidence-Matrix
+    """
+    coincidence_matrix = {}
+    # fill the coincidence matrix with all keys and the start value 0
+    for c in together_with:
+        for k in together_with:
+            key = (c, k)
+            coincidence_matrix[key] = 0
+
+    # iterate over all units in the reliability-matrix. A row represents a unit.
+    for _, unit in of.iterrows():
+        # by dropping all NaNs in the data it can ensured that this code works for sparse date too.
+        unit = unit.dropna().tolist()
+        # m_u represents all received ratings for unit. This is equivalent to the len of the list of the values
+        # for a unit if all NaNs are eliminated.
+        m_u = len(unit)
+        # calculate ock
+        unit_pairs = []
+        # Generate all possible c-k-Pairs by fixing one element and iterating over the remaining elements.
+        for c in range(0, len(unit)):
+            for k in range(0, len(unit)):
+                if c != k:
+                    unit_pairs += [(unit[c], unit[k])]
+        # count each c-k-Pair
+        counted_unit_pairs = Counter(unit_pairs)
+        # fill the coincidence matrix by adding the current sum of the corresponding c-k-Pair of a unit
+        for counted_unit_pair in counted_unit_pairs:
+            # like foil 59 of lecture 4.6
+            coincidence_matrix[counted_unit_pair] += counted_unit_pairs[counted_unit_pair] / (m_u - 1)
+    return coincidence_matrix
+
+
+def generate_n_categories(of: dict, together_with: set) -> dict:
+    """
+    Generate the n_categories which is equivalent to the row or columns sum of a specific category in the coincidence-matrix.
+    Notice: The sum over all n_categories must be equivalent to all given ratings in the reliability-matrix.
+
+    :param of: Coincidence-Matrix of which the n_categories should be generated.
+    :param together_with: Categories which are used in the coincidence-matrix.
+    :return: Row und Column sum of the categories in the coincidence-matrix.
+    """
+    n_categories = {}
+    for category in together_with:
+        row_sum = 0
+        col_sum = 0
+        for coincidence in of.keys():
+            # get the row sum
+            if coincidence[0] == category:
+                row_sum += of[coincidence]
+            # get the column sum
+            if coincidence[1] == category:
+                col_sum += of[coincidence]
+        # the row and column sum must be the same since the coincidence-matrix is symmetric.
+        if row_sum == col_sum:
+            n_categories[category] = col_sum
+        else:
+            n_categories[category] = 0
+    return n_categories
+
+
+def generate_D_o(of: dict, together_with: set) -> float:
+    """
+    Generate the value if the observed disagreement like mentioned on foil 51 if lecture 4.6.
+
+    :param of: Coincidence-Matrix of which the observed disagreement should be generated of.
+    :param together_with: Categories which are used for the coincidence-matrix.
+    :return: Value of the observed disagreement.
+    """
+    D_o = 0
+    for c in together_with:
+        for k in together_with:
+            D_o += of[(c, k)] * (0 if c == k else 1)
+    return D_o / n
+
+
+def generate_D_e(of: dict, together_with: set) -> float:
+    """
+    Generate the value of the expected disagreement like mentioned on foil 51 lecture 4.6.
+
+    :param of: n_categories which represent the expectation.
+    :param together_with: Categories which are used for the coincidence-matrix.
+    :return: Value of the expected disagreement.
+    """
+    D_e = 0
+    n = sum(of.values())
+    for c in together_with:
+        for k in together_with:
+            D_e += of[c] * of[k] * (0 if c == k else 1)
+    return D_e / (n * (n - 1))
+
+
+if __name__ == '__main__':
+    """
+    This program calculates the Krippendorff's alpha for the IA-A.
+    To run this program use:
+    
+        $ python3 krippendorff.py <path-to-csv-file>
+    
+    Notice: <path-to-csv-file> should be in the same folder like krippendorff.py
+    Example:
+    
+        $ python3 krippendorff.py example.py
+    
+    This will run the example from from foil 58 lecture 4.6.    
+    """
+    if len(sys.argv) != 2:
+        raise Exception("Expected 2 arguments, but got {}".format(len(sys.argv)))
+    filename = "./{}".format(sys.argv[1])
+    frame = pd.read_csv(filename)
+    reliability_matrix = generate_reliability_matrix(of=frame)
+
+    categories = generate_categories(of=reliability_matrix)
+    coincidences = generate_coincidence_matrix(of=reliability_matrix, together_with=categories)
+
+    # generate the n_categories to the if the results are correct
+    n_categories = generate_n_categories(of=coincidences, together_with=categories)
+
+    # the sum over the categies is equal to all entries in reliability matrix
+    n = sum(n_categories.values())
+    n_reliable = len(pd.Series(reliability_matrix.values.flatten()).dropna())
+    if n != n_reliable:
+        raise Exception(
+            "Sum of the categories in the coincidence-matrix does not match the reliability-data: Should have {} categories used, but was {}".format(
+                n_reliable, n))
+    D_o = generate_D_o(of=coincidences, together_with=categories)
+    D_e = generate_D_e(of=n_categories, together_with=categories)
+    alpha = 1 - (D_o / D_e)
+    print("Alpha={value}".format(value=round(alpha, 4)))

least_happy_data.csv

+item,tweet1,tweet2,tweet3,tweet4,rating1,rating2,rating3,rating4,rating5,rating6,rating7,rating8,rating9,rating10,rating11,rating12,rating13,rating14,rating15,rating16,rating17,rating18,rating19,rating20,rating21,rating22,rating23,rating24,rating25,rating26,rating27,rating28,rating29,rating30,rating31,rating32,rating33,rating34,rating35,rating36,rating37,rating38,rating39,rating40,rating41,rating42
+1,"laughter is such a powerful thing and everybody deserves to laugh, if u like shitty romcoms and get a giggle outta planet uranus, power to u",Riggs dumb ass hell lolol  #LethalWeapon        ,"Oh that cheery fucking note, good night shit heads X    ",Quinn's short hair makes me sad.,4,4,4,3,4,3,4,3,3,4,4,3,3,3,2,4,1,3,4,4,3,3,4,3,3,4,4,3,4,4,4,4,4,3,4,4,4,4,4,4,4,3
+2,"Dehydrated, exhausted, stressed but still blessed.",Do what makes you successful and #happy now and forever ,It's Thursday which means it's Grey's day #TGIT #rejoice        ,I truly believe in my heart right now that Satan is rejoicing because we are all against one another    ,2,4,4,4,4,4,4,4,4,4,4,3,4,4,4,4,4,4,4,4,4,4,2,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,1,4,4
+3,This meth documentary is exhilarating   ,Omg. You've got to watch the new series 'This is Us'.....wow. Best tv show I've seen in a long time.\n #tears  #moretears       ,#OneSimpleChange: Drink sparkling water instead of soft drinks to steer clear of fructose while still getting a refreshing carbonation kick.    ,Twitter is a font of endless hilarity.,3,3,2,3,1,3,4,3,4,1,1,4,3,4,3,3,1,3,4,3,3,3,3,3,4,4,3,3,3,3,3,3,3,1,1,2,3,3,4,4,1,4
+4,Please stop your merriment. It is very annoying,"I'm due for a big change! I've prayed on it, I think I deserve it #positivity","And the weather so breezy, man why can't life always be this easy       ",It's meant to be!!,2,1,1,1,1,1,1,1,1,1,1,2,1,3,1,1,1,1,1,1,1,1,1,4,1,1,1,1,1,1,1,3,1,1,1,1,1,1,1,1,3,1
+5,@URClassless I think that yawning actor died of a drug overdose. #glee,I turn 25 in two weeks. I am so happy. 24 was my darkest year yet. I am elated that I survived  ,The #chiropractor makes me so #happy.,Accept the challenges so that you can feel the exhilaration of victory!!        ,2,1,1,1,1,1,1,1,1,1,2,1,1,1,1,1,2,1,2,1,1,4,1,1,1,2,1,2,1,1,2,1,1,2,1,1,1,1,2,1,2,1
+6,Always hurting somewhere..... ALWAYS tired ....when are you lively ??   ,"Be it a rainy day, be it cheerful sunshine, I am a Prussian, want nothing to be but a Prussian.:|       ",i'm doing laundry and watching that 70's show with a bunch of strangers.  #birthday #to #me     ,Research has determined 70% of #laughter is actually #anxiety.,3,1,1,1,3,1,1,1,1,1,1,3,1,1,1,1,4,1,1,1,1,2,1,1,3,1,3,1,1,3,1,4,1,1,1,1,1,1,3,1,1,1
+7,Your future is bright. #Remember,hate overthinking e v e r y t h i n g like i jus' wanna be happy pls,her; i want a playful relationship\nme; *kicks her off the couch*       ,smiling through the stress :) :) :) :) :) :) :( :( :( :( :( :( :(       ,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,2,4,2,2,2,2,2,2,4,2,2,4,2,2,2,2,2,2,2,3,2,2,2,2,2,2,2
+8,in love with @BarberCeleste  insta!!!... #hilarious     ,May the optimism of tomorrow be your foundation for today.      ,@adamrodricks I like your optimism!     ,hate overthinking e v e r y t h i n g like i jus' wanna be happy pls,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,4,2,4,4,2
+9,its been ages since ive had shawarma my stomach is #rejoicing   ,"I am a simple human being who just really loves @aliciakeys like truly, madly, deeply rejoicing in her existence, class and queendom    ","When you wake up from a dream laughing at something stupid, and that makes you laugh more #hilarious    ",only time I am ever cheering for you Johnny     ,4,4,2,4,4,4,2,4,4,4,1,1,4,4,4,4,4,4,4,4,1,4,4,3,4,1,4,4,4,2,4,4,4,4,1,1,4,4,4,4,1,4
+10,gifs on iOS10 messaging app are hilarious.      ,i wonder how gleeful it is to be dumb af and see the world through rose tinted glasses,I really hate Mel and Sue. They think they're hilarious and they're just awful,"@david_garrett Quite saddened.....no US dates, no joyous anticipation of attending a DG concert (since 2014). Happy you are keeping busy.       ",4,3,3,3,3,3,4,3,3,3,2,2,3,3,3,3,2,3,3,4,3,4,2,4,3,3,3,3,3,4,2,3,4,3,3,2,3,2,4,4,4,2
+11,I love my family so much #lucky #grateful #smartassfamily #hilarious #love      ,"Pinky is so funny n jovial, bt she got emotional n just brought me 2 tears. I felt so bad for her #Ishqbaaaz",Did u laugh today? Laugh hard? I hope so..we NEED laughter now. #smile #love,tweet tweet chirp chirp losers  ,3,4,3,4,4,4,3,2,3,2,2,3,4,4,4,4,2,4,2,2,4,4,2,2,4,4,4,3,2,2,4,4,2,2,4,4,2,2,3,3,4,4
+12,"To all who follow me, whether we've ever talked or not hope you have a joyous life. Goodbye.",sometimes im sad then remember Margaret Thatcher is dead and then i rejoice,"If yiu don't respond .o an email within 7 days, you willxbe killed by an animated gif of the girl froa The Ri.g.        ",I found #marmite in Australia. `:),3,3,1,3,3,1,1,4,1,3,1,1,3,1,3,3,2,1,2,1,3,1,1,4,1,3,1,1,3,2,1,2,3,3,3,3,1,1,1,3,2,1
+13,Panda eyed jaunty after watching jaws until late!       ,"Yes Mourinho, you really should stop speaking about refs! And try cheering up a bit.    ","Yahweh your God is among you, a warrior who saves. He will rejoice over you with gladness.      ","So much news about Pakistan, Afghanistan, etc. We need more cheery news about Frybread Stands!!! Everyone in media just so grim.",2,4,4,4,4,4,2,4,4,2,2,4,2,4,4,4,3,3,4,4,4,4,4,4,4,2,2,2,2,4,2,2,4,4,2,4,4,2,4,1,2,2
+14,"Lucina, that's fantastic! When you feel cheery, we ALL feel cheery!",LOVE LOVE LOVE  #fun #relaxationiskey,"Lmboo , using my nephew for meme ","Iniesta still the one player I idolize from Barca,a delight to watch I tell you",3,4,3,3,3,4,4,3,1,1,4,4,4,1,3,3,1,4,3,3,3,3,2,3,4,1,1,3,3,4,3,3,3,3,3,3,4,3,3,3,4,3
+15,second day on the job and i already got a 45 dollar tip from a dude whose was constantly twitching his eye LOLOLOL #cheering    ,"This tweet is dedicated to my back pain, which I do not understand because I am youthful and spry. Full of life. Vivacious.",I hate it when im singing and some idiot thinks they can just join in with me like...this is not fcking glee #MeanRikonaBot     ,"Imagine how sad LA fans are gona be when they get eliminated...Man that's gonna be Nirvana, a religious experience rejoicing in their misery    ",2,3,3,3,3,3,2,2,3,3,2,3,3,3,3,3,1,2,3,2,4,2,2,3,3,2,2,4,2,2,3,2,3,3,3,3,2,2,3,3,3,1
+16,"I took a yr off school and I'm proud to say I got accepted again, yo girl is going to finish! #happy    ",How did Ryan Murphy create both #AHS and #glee \nSo different   ,But I got to see her last when she was lively and talkative and I was able to tell her I loved her so that's what matters.      ,Some People hate nothing more than a happy confident person. Never mind #happy #confident,2,2,3,2,2,2,3,2,3,2,3,3,3,4,3,3,4,3,3,3,3,2,3,3,2,3,3,3,3,3,3,3,4,2,2,3,4,3,4,2,4,4
+17,"On my way rejoicing, to the pulpit @ Park City Baptist Church, Surrey BC. for Midweek Service.","But the lady at the store said I had nice eyelashes so that's good, right? #optimism? @verizon  ","Haven't yet read why Dutch drivers are so happy, but here's my theory: because they could quit driving and still have great transpo options.    ",jstor's lingua obscura articles are always such a delight       ,3,3,3,3,4,4,2,3,3,3,2,3,3,4,3,3,1,3,2,2,2,3,2,3,1,3,3,2,2,3,3,2,2,2,2,2,2,2,1,2,1,2
+18,"The feeling of taking someone's life is either scarring or exhilarating, but for people need to realize that we're going to die at some--       ",I love looking at my old statuses on Facebook. The one I have from four years ago on this day was about #glee. I had so many opinions...        ,I miss my naivety and blind optimism    ,I understand now...if it's not pleasing to the ear...then it ain't what you want! I'm so so tired!!     ,1,3,4,1,4,3,4,4,1,3,3,4,4,4,4,4,3,1,3,3,4,4,3,2,4,1,3,4,4,3,4,3,3,1,1,4,1,4,3,4,1,2
+19,There's a certain hilarity in people angry at protests against the national anthem or the flag when these acts are covered by 1st Amendment.    ,When my friends send me ballons and fireworks through text...#amazing #smiling  ,Batman the animated series is a gift from the 90s animation gods        ,I feel like one of my friends brought this freshmen in my class over to pre game earlier in the year bc she keeps smiling at me joy     ,4,4,1,1,1,1,1,1,1,1,1,4,1,1,1,1,1,3,1,1,1,1,1,4,1,2,1,3,1,1,1,1,1,1,1,1,3,1,1,1,1,1
+20,"Coworker: 'That happened to a friend of mine once, but with guns instead of babies.' #workplace #hilarity       ",Bet pawpaw is having a good time rejoicing up in heaven for his first birthday there!   ,Asked one thing from our guys tonight and got it! #happy #proud #disappointed - THAT IS FOOTBALL #timetoclimbthetable,"#IfIWerePresident \nMy goal would be for us all to be miserable, yet jovial in the Co. of others. U know, civil but with realization of self.   ",1,4,1,2,4,4,1,4,1,2,3,2,2,4,2,4,1,4,2,2,4,2,4,2,4,2,2,1,2,4,2,2,4,4,4,4,4,4,3,3,2,4

most_happy_data.csv

+item,tweet1,tweet2,tweet3,tweet4,rating1,rating2,rating3,rating4,rating5,rating6,rating7,rating8,rating9,rating10,rating11,rating12,rating13,rating14,rating15,rating16,rating17,rating18,rating19,rating20,rating21,rating22,rating23,rating24,rating25,rating26,rating27,rating28,rating29,rating30,rating31,rating32,rating33,rating34,rating35,rating36,rating37,rating38,rating39,rating40,rating41,rating42
+1,"laughter is such a powerful thing and everybody deserves to laugh, if u like shitty romcoms and get a giggle outta planet uranus, power to u",Riggs dumb ass hell lolol  #LethalWeapon        ,"Oh that cheery fucking note, good night shit heads X    ",Quinn's short hair makes me sad.,2,3,3,1,2,2,2,2,1,1,2,1,1,1,1,1,2,2,1,2,1,2,2,1,1,1,2,1,1,2,2,2,1,1,1,1,1,3,2,2,1,2
+2,"Dehydrated, exhausted, stressed but still blessed.",Do what makes you successful and #happy now and forever ,It's Thursday which means it's Grey's day #TGIT #rejoice        ,I truly believe in my heart right now that Satan is rejoicing because we are all against one another    ,3,3,3,1,1,2,3,3,2,3,1,4,2,1,3,3,3,3,3,3,2,3,3,1,3,2,1,1,3,2,2,1,3,2,1,2,2,1,1,3,2,2
+3,This meth documentary is exhilarating   ,Omg. You've got to watch the new series 'This is Us'.....wow. Best tv show I've seen in a long time.\n #tears  #moretears       ,#OneSimpleChange: Drink sparkling water instead of soft drinks to steer clear of fructose while still getting a refreshing carbonation kick.    ,Twitter is a font of endless hilarity.,2,4,4,2,2,2,2,2,2,2,2,2,4,2,2,2,4,2,2,2,2,2,2,2,2,2,2,4,2,2,4,2,2,2,4,4,2,2,1,2,2,2
+4,Please stop your merriment. It is very annoying,"I'm due for a big change! I've prayed on it, I think I deserve it #positivity","And the weather so breezy, man why can't life always be this easy       ",It's meant to be!!,3,3,2,2,3,3,3,2,2,3,2,3,2,1,2,2,3,3,3,4,3,3,2,3,2,4,3,3,4,2,2,2,3,3,4,2,3,3,4,2,2,2
+5,@URClassless I think that yawning actor died of a drug overdose. #glee,I turn 25 in two weeks. I am so happy. 24 was my darkest year yet. I am elated that I survived  ,The #chiropractor makes me so #happy.,Accept the challenges so that you can feel the exhilaration of victory!!        ,4,2,2,4,2,4,3,3,2,3,3,2,4,2,2,3,4,3,4,3,2,2,2,3,2,4,2,4,2,3,3,2,2,3,4,4,2,3,3,2,4,4
+6,Always hurting somewhere..... ALWAYS tired ....when are you lively ??   ,"Be it a rainy day, be it cheerful sunshine, I am a Prussian, want nothing to be but a Prussian.:|       ",i'm doing laundry and watching that 70's show with a bunch of strangers.  #birthday #to #me     ,Research has determined 70% of #laughter is actually #anxiety.,2,3,2,2,2,3,3,2,2,4,3,2,2,3,3,3,3,3,2,3,2,4,2,2,2,3,2,2,3,4,4,3,3,2,2,2,3,3,2,3,3,3
+7,Your future is bright. #Remember,hate overthinking e v e r y t h i n g like i jus' wanna be happy pls,her; i want a playful relationship\nme; *kicks her off the couch*       ,smiling through the stress :) :) :) :) :) :) :( :( :( :( :( :( :(       ,3,1,4,1,4,1,3,3,1,3,3,3,1,1,1,1,3,3,1,3,1,1,3,1,1,1,1,3,1,1,1,1,1,1,1,3,1,1,1,3,3,3
+8,in love with @BarberCeleste  insta!!!... #hilarious     ,May the optimism of tomorrow be your foundation for today.      ,@adamrodricks I like your optimism!     ,hate overthinking e v e r y t h i n g like i jus' wanna be happy pls,1,1,1,1,1,1,1,1,1,1,3,1,1,2,2,2,2,1,3,1,2,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,3
+9,its been ages since ive had shawarma my stomach is #rejoicing   ,"I am a simple human being who just really loves @aliciakeys like truly, madly, deeply rejoicing in her existence, class and queendom    ","When you wake up from a dream laughing at something stupid, and that makes you laugh more #hilarious    ",only time I am ever cheering for you Johnny     ,3,2,1,2,3,3,4,2,3,3,3,2,3,3,3,3,1,3,2,1,3,1,2,2,1,3,3,3,2,3,3,2,2,3,3,2,3,2,1,1,3,2
+10,gifs on iOS10 messaging app are hilarious.      ,i wonder how gleeful it is to be dumb af and see the world through rose tinted glasses,I really hate Mel and Sue. They think they're hilarious and they're just awful,"@david_garrett Quite saddened.....no US dates, no joyous anticipation of attending a DG concert (since 2014). Happy you are keeping busy.       ",1,1,4,1,1,1,1,1,2,1,1,1,4,1,1,1,3,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1
+11,I love my family so much #lucky #grateful #smartassfamily #hilarious #love      ,"Pinky is so funny n jovial, bt she got emotional n just brought me 2 tears. I felt so bad for her #Ishqbaaaz",Did u laugh today? Laugh hard? I hope so..we NEED laughter now. #smile #love,tweet tweet chirp chirp losers  ,1,1,1,1,1,3,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1
+12,"To all who follow me, whether we've ever talked or not hope you have a joyous life. Goodbye.",sometimes im sad then remember Margaret Thatcher is dead and then i rejoice,"If yiu don't respond .o an email within 7 days, you willxbe killed by an animated gif of the girl froa The Ri.g.        ",I found #marmite in Australia. `:),1,1,4,2,4,3,4,1,2,2,4,2,4,4,4,4,1,4,1,2,4,2,4,2,4,4,4,2,4,1,4,1,2,1,1,4,4,2,2,2,4,4
+13,Panda eyed jaunty after watching jaws until late!       ,"Yes Mourinho, you really should stop speaking about refs! And try cheering up a bit.    ","Yahweh your God is among you, a warrior who saves. He will rejoice over you with gladness.      ","So much news about Pakistan, Afghanistan, etc. We need more cheery news about Frybread Stands!!! Everyone in media just so grim.",1,1,1,3,3,1,3,3,3,4,3,1,3,3,3,3,2,1,1,3,1,1,1,3,1,3,3,3,1,1,3,4,3,1,3,1,1,1,1,2,3,1
+14,"Lucina, that's fantastic! When you feel cheery, we ALL feel cheery!",LOVE LOVE LOVE  #fun #relaxationiskey,"Lmboo , using my nephew for meme ","Iniesta still the one player I idolize from Barca,a delight to watch I tell you",2,2,2,2,2,3,3,1,2,2,2,1,2,3,2,2,2,1,1,1,2,1,1,2,1,2,4,1,1,1,2,2,2,1,2,2,2,2,1,4,1,1
+15,second day on the job and i already got a 45 dollar tip from a dude whose was constantly twitching his eye LOLOLOL #cheering    ,"This tweet is dedicated to my back pain, which I do not understand because I am youthful and spry. Full of life. Vivacious.",I hate it when im singing and some idiot thinks they can just join in with me like...this is not fcking glee #MeanRikonaBot     ,"Imagine how sad LA fans are gona be when they get eliminated...Man that's gonna be Nirvana, a religious experience rejoicing in their misery    ",1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,3,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,4,1,1,1,2
+16,"I took a yr off school and I'm proud to say I got accepted again, yo girl is going to finish! #happy    ",How did Ryan Murphy create both #AHS and #glee \nSo different   ,But I got to see her last when she was lively and talkative and I was able to tell her I loved her so that's what matters.      ,Some People hate nothing more than a happy confident person. Never mind #happy #confident,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,4,1,1,1,1,1,1,1,1,1,1,1,1,3,1,1,1,1,3,1,1
+17,"On my way rejoicing, to the pulpit @ Park City Baptist Church, Surrey BC. for Midweek Service.","But the lady at the store said I had nice eyelashes so that's good, right? #optimism? @verizon  ","Haven't yet read why Dutch drivers are so happy, but here's my theory: because they could quit driving and still have great transpo options.    ",jstor's lingua obscura articles are always such a delight       ,1,4,1,4,2,2,1,1,4,2,4,4,4,3,2,2,2,4,1,4,4,4,4,1,2,4,4,4,1,4,4,4,4,4,4,1,4,4,4,4,2,1
+18,"The feeling of taking someone's life is either scarring or exhilarating, but for people need to realize that we're going to die at some--       ",I love looking at my old statuses on Facebook. The one I have from four years ago on this day was about #glee. I had so many opinions...        ,I miss my naivety and blind optimism    ,I understand now...if it's not pleasing to the ear...then it ain't what you want! I'm so so tired!!     ,2,2,2,2,2,2,2,2,2,2,4,2,2,3,2,2,2,2,2,2,2,2,1,4,2,3,2,2,2,1,2,2,2,2,2,2,2,1,2,2,2,3
+19,There's a certain hilarity in people angry at protests against the national anthem or the flag when these acts are covered by 1st Amendment.    ,When my friends send me ballons and fireworks through text...#amazing #smiling  ,Batman the animated series is a gift from the 90s animation gods        ,I feel like one of my friends brought this freshmen in my class over to pre game earlier in the year bc she keeps smiling at me joy     ,3,2,2,2,4,2,2,2,2,3,4,2,3,3,2,2,4,2,3,4,4,4,4,2,2,3,3,4,2,2,2,4,2,2,2,4,2,2,2,4,4,2
+20,"Coworker: 'That happened to a friend of mine once, but with guns instead of babies.' #workplace #hilarity       ",Bet pawpaw is having a good time rejoicing up in heaven for his first birthday there!   ,Asked one thing from our guys tonight and got it! #happy #proud #disappointed - THAT IS FOOTBALL #timetoclimbthetable,"#IfIWerePresident \nMy goal would be for us all to be miserable, yet jovial in the Co. of others. U know, civil but with realization of self.   ",3,1,2,3,3,2,3,1,3,1,1,3,3,3,4,3,2,1,1,3,3,1,1,3,3,3,1,3,3,3,1,1,3,2,1,3,3,3,1,1,4,1