Is pointer generator networks approach is really Abstractive approach?

I have set up this repo. now all my output are the selection of sentences from the original text. how this can be Abstractive?

even test data has the same type of out.

Example
Decoded Summary:

obama says he is `` absolutely committed to making sure '' israel maintains a military advantage over iran .his comments to the new york times published on sunday , come amid criticism from israeli prime minister benjamin netanyahu .

Original Text:
washington ( cnn ) president barack obama says he is `` absolutely committed to making sure '' israel maintains a military advantage over iran . his comments to the new york times , published on sunday , come amid criticism from israeli prime minister benjamin netanyahu of the deal that the united states and five other world powers struck with iran . tehran agreed to halt the country ‘s nuclear ambitions , and in exchange , western powers would drop sanctions that have hurt the iran ‘s economy . obama said he understands and respects netanyahu ‘s stance that israel is particularly vulnerable and does n’t have the luxury of testing these propositions '' in the deal . but what i would say to them is that not only am i absolutely committed to making sure they maintain their qualitative military edge , and that they can deter any potential future attacks , but what i ‘m willing to do is to make the kinds of commitments that would give everybody in the neighborhood , including iran , a clarity that if israel were to be attacked by any state , that we would stand by them , ” obama said . that , he said , should be sufficient to take advantage of this once-in-a-lifetime opportunity to see whether or not we can at least take the nuclear issue off the table , '' he said . the framework negotiators announced last week would see iran reduce its centrifuges from 19,000 to 5,060 , limit the extent to which uranium necessary for nuclear weapons can be enriched and increase inspections . the talks over a final draft are scheduled to continue until june 30 . but netanyahu and republican critics in congress have complained that iran wo n't have to shut down its nuclear facilities and that the country 's leadership is n't trustworthy enough for the inspections to be as valuable as obama says they are . obama said even if iran ca n't be trusted , there 's still a case to be made for the deal . in fact , you could argue that if they are implacably opposed to us , all the more reason for us to want to have a deal in which we know what they ‘re doing and that , for a long period of time , we can prevent them from having a nuclear weapon , ” obama said .

The whole idea of the pointer network feature is to be able to copy tokens directly from the source, which, by definition, is an extractive process.

In fact, the pointer-generator precisely chose wether to behave extractively or abstractively. This “extractiveness” is the p_gen in equation (8).

–pltrdy

 

 

In principle, part of what the pointer-generator model learns is whether to abstract or extract at each time step, however in practice, it is more common to see choose to extract, and yes sometimes the entire output is extractive. Posting one anecdote is not really making a case though.

You should check out this paper to see how abstraction can be measured quantitatively across the entire CNN / DailyMail dataset and how the model in this repo stacks up against the others being researched. Several papers have also studied this particular dataset and come to the conclusion that it biases models toward extractive summarization since the summaries are bullet point sentences, often using words and phrases taken directly from the article. Exactly how much of what you are observing comes from the model and how much comes from the dataset is hard to say.

shellshock1911