Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Analysis of the restricted corpus #57

Open
vcvpaiva opened this issue Feb 12, 2017 · 17 comments
Open

Analysis of the restricted corpus #57

vcvpaiva opened this issue Feb 12, 2017 · 17 comments

Comments

@vcvpaiva
Copy link
Member

vcvpaiva commented Feb 12, 2017

According to stats (https://github.com/own-pt/rte-sick/blob/master/expanded/conllu/len.3-5.conllu.stats.xml)
390 sentences (385 nsubj+5nsubjpass), 1 conjunction only, 4 dependencies 'dep', 13 copulas, 140 direct objects, 26 expletives, 19 negations and 20 noun-nouns.

1 prep and 9 particles.

The rest is:
"acomp"=2
"advmod"=34
"amod"= 20
"partmod"= 10
"pobj"= 1

also 30 ADJ, 45 ADV
"quantmod"= 3

@vcvpaiva
Copy link
Member Author

only conjunction is:

Paper and scissors both cut

scissors has lemmatization problem, no concept found. paper is wrong concept, newspaper. cut is wrong concept, process only.

want to distribute? enhanced CoreNLP does.

@vcvpaiva
Copy link
Member Author

vcvpaiva commented Feb 12, 2017

13 copulas:
(one can check https://github.com/own-pt/rte-sick/blob/master/expanded/conllu/len.3-5.conllu)

  1. Some people are silent
  2. The child is silent
  3. A classroom is empty
  4. A man is motionless
  5. A man is scared
  6. The fish are immobile
  7. A man is silent
  8. A biker is naked
  9. The man is training ****
  10. Some kittens are hungry
  11. The man is rock climbing ****
  12. A woman is grating carrots ****
  13. The woman is dicing garlic ****

4 copulas are wrong as far as dependencies are concerned.
others are wrong as far as the mapping is concerned, later.

@vcvpaiva
Copy link
Member Author

vcvpaiva commented Feb 12, 2017

19 negations marked:

  1. A fish is not swimming
  2. Two men are not fighting
  3. The men are not dancing
  4. A person is not frying
  5. People are not playing cricket
  6. The men are not talking
  7. The band isn't singing (noticed n't working fine!)
  8. The person is not drawing
  9. A man is not dancing
  10. The man is not dancing
  11. The man is not exercising
  12. The woman is not waterskiing
  13. The woman is not dancing
  14. Someone is not playing piano
  15. Some women are not talking
  16. A horse is not racing
  17. Two women are not dancing
  18. A jet is not flying
  19. The man is not drawing

all dependencies seem fine.

However there are several semantic negations that are not marked.

  1. No person is hiking
  2. There are no men fighting
  3. There is no man speaking
  4. There is no man drawing
  5. There is no dog barking
  6. There is no person writing
  7. There is no man spitting
  8. There is no band playing
  9. There is no parrot speaking
  10. There is no man exercising
  11. There is no baby talking
  12. There is no man mixing
  13. There is no man dancing
  14. There is no panda climbing
  15. There is no lion walking (amb?)
  16. There is no hamster singing
  17. There is no lemur eating (amb)
  18. There is no woman exercising
  19. There is no clown singing
  20. There is no one typing
  21. There is no woman dancing
  22. There is no puppy rolling
  23. There is no man praying
  24. There is no man screaming
  25. There are no mimes performing
  26. There are no men sawing
  27. There is no man thinking

and also:

  1. Nobody is riding a bike
  2. Nobody is playing ping pong
  3. Nobody is holding a hedgehog
  4. Nobody is feeding an animal
  5. Nobody is slicing a tomato
  6. Nobody is brushing a cat
  7. Nobody is beating an egg
  8. Nobody is playing the guitar
  9. Nobody is riding a bike
  10. Nobody is playing ping pong

@vcvpaiva
Copy link
Member Author

vcvpaiva commented Feb 13, 2017

Looking for the 20 nns is difficult, as the reps use NN for noun.
However, the first 7 noun-nouns below seem correct. and to give them concepts, they need to be considered compounds.

  1. ping pong
  2. golden retriever
  3. sumo wrestlers
  4. tiger cub
  5. sumo ringers
  6. baby pandas 2x
  7. cartoon airplane

Wrong ones:

  1. men sawing (nn)
  2. man screaming (dep)
  3. puppy rolling
  4. woman dancing
  5. clown singing
  6. hamster singing
  7. lion walking
  8. panda climbing
  9. man dancing
  10. rock climbing
  11. baby talking
  12. band playing
  13. dog barking
  14. blonds girl (typo)

@vcvpaiva
Copy link
Member Author

there are 4 dependencies "dep"

  1. There is no man speaking (speaking)
  2. Paper and scissors both cut (both)
  3. A kitten is getting bored (getting)
  4. There is no man screaming (screaming)

@vcvpaiva
Copy link
Member Author

vcvpaiva commented Feb 13, 2017

"acomp"=2 ===> falling asleep.
"quantmod"===> 3 "a few"
"amod"= 20 ===> correct ones:
old woman, young female, young kids, cold cyclist, happy baby, young girl, white horse, sad man, hungry woman, small animal

wrong ones: a few kittens, few men, several children,
lemur eating, one typing, grating carrots, dicing garlic, golden retriever, animated airplane, man thinking,

@vcvpaiva
Copy link
Member Author

vcvpaiva commented Feb 13, 2017

particle verbs:

  1. take off 3
  2. laying down
  3. sitting down
  4. waking up 2
  5. standing up 2
    Note that this particles do mess up the concepts assignment, e.g.
# text = A toddler is standing up
1	A	a	DET	DT	_	2	det	_	DT|?|?
2	toddler	toddler	NOUN	NN	_	4	nsubj	_	NN|10714465-n|NonFullyFormed+
3	is	be	VERB	VBZ	_	4	aux	_	VBZ|02604760-v|Entity+
4	standing	stand	VERB	VBG	_	0	ROOT	_	VBG|01546111-v|PhysicalAttribute+
5	up	up	PRT	RP	_	4	prt	_	RP|00097011-r|Increasing+

only one preposition:
Someone is on a horse

@vcvpaiva
Copy link
Member Author

expletives

  1. There are no men fighting (wrong root)
  2. There is no man speaking
  3. There is no man drawing
  4. There is no dog barking
  5. There is no person writing
  6. There is no man spitting
  7. There is no band playing

@vcvpaiva
Copy link
Member Author

5 passive voices only, all correct.

  1. A boat is anchored
  2. A pencil is being sharpened
  3. An onion is being chopped
  4. An onion is being sliced
  5. Some paper is being cut

@vcvpaiva
Copy link
Member Author

advmodifiers: (34 in total)

  1. quickly 2
  2. happily 2
  3. frantically
  4. gracefully 2
  5. slowly
  6. wildly
  7. noisily
  8. passionately
  9. cheerfully
  10. fervently
  11. loudly
  12. fearlessly

Others:

  1. together
  2. still
  3. outside
  4. inside
  5. indoors
  6. around
  7. alone
  8. downhill
  9. uphill

@vcvpaiva
Copy link
Member Author

actually in the whole corpus we have 112 adverbs ending in "ly" -- this is for future use in the nomlex for adjective/adverbs. they're attached.
sadverbs.txt

@vcvpaiva
Copy link
Member Author

vcvpaiva commented Feb 22, 2017

I do not understand why only the verb "sit" gives a different meaning to the auxiliary "to be".
Sentences: A person is sitting, A man is sitting, A baby is sitting, A tiger is sitting, A toddler is sitting, the man is sitting indoors-- all give "is" as PhysicalAttribute instead of Entity+.
Yes, "sit" is an state, not an action, but so is "standing".

@arademaker
Copy link
Member

@vcvpaiva once more, so answer this puzzle we need an interactive implementation of UKB with a traces! We would need to see how the algorithm evolves during the computation to choose a sense A instead of a sense B for a given word W.

@vcvpaiva
Copy link
Member Author

1 occ of man mapping to Man, 111 occs mapping to Hominid?
140 occs of woman mapping to Woman
9 Guitars, 11 Canines
32 playing ==> DramaticActing, 32 dancing ==> Dancing+
24 Separating, from slice, dismantle and tear

@vcvpaiva
Copy link
Member Author

vcvpaiva commented Feb 26, 2017

17 correct adjectives: empty, hungry, immobile
naked, motionless, silent
scared, animated, bored
happy, sad
golden, white
young, old
small
asleep

some of the adjectives are past participles: scared, animated, bored which causes problems.

@vcvpaiva
Copy link
Member Author

vcvpaiva commented Mar 22, 2017

only 50 nsubjs, kind of:

  1. man
  2. male
  3. boy
  4. woman
  5. lady
  6. girl
  7. female
  8. child
  9. kid
  10. toddler
  11. baby

  1. clown
  2. cheerleader
  3. speaker
  4. biker
  5. ringer (sumo)
  6. wrestler
  7. mime
  8. cyclist
  9. band
  10. team
  11. someone
  12. nobody/ no one
  13. people
  14. person

  1. fish
  2. kitten
  3. cat
  4. dog
  5. golden retriever
  6. lemur
  7. cow
  8. panda
  9. tiger
  10. lion
  11. horse
  12. parrot
  13. cub
  14. hamster
  15. squirrel
  16. animal

  1. classroom (place, not the people)
  2. plane
  3. airplane
  4. jet
  5. boat
  6. pencil
  7. keyboard
  8. barbells
  9. paper
  10. onion

@vcvpaiva
Copy link
Member Author

vcvpaiva commented Mar 22, 2017

dobjs:

  1. play cricket/soccer/rugby
  2. receive volleyball
  3. play piano/keyboard/guitar/flute
  4. strum guitar
  5. cut wood
  6. cut shrimps/tomatoes/garlic/potatoes/butter
  7. slice garlic/butter/potatoes/herbs/tomato/bread/tofu
  8. chop onion/garlic
  9. dice onion
  10. mix eggs
  11. beat eggs
  12. dry noodles/eggs
  13. saw logs
  14. likes parrots
  15. cook prawns/eggs
  16. boil shrimps/eggs/noodles
  17. peel banana/food
  18. store broccoli
  19. break eggs/
  20. crack eggs
  21. tear sheets
  22. hold a hedgehog
  23. cleanse animal
  24. brush a cat
  25. dirty animal
  26. feed animal
  27. spread dough
  28. lump dough
  29. eat cereal/grass
  30. amalgamate eggs
  31. lift barbells
  32. mow grass
  33. read email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants