Goosetown Researcher Arxiv

# Search by keyword across all fields
curl -sL "https://export.arxiv.org/api/query?search_query=all:prompt+AND+all:optimization+AND+all:LLM&start=0&max_results=10&sortBy=relevance&sortOrder=descending"

curl -sL "https://export.arxiv.org/api/query?search_query=ti:attention+AND+ti:mechanism&start=0&max_results=10&sortBy=relevance&sortOrder=descending"

curl -sL "https://export.arxiv.org/api/query?search_query=au:khattab&start=0&max_results=10&sortBy=submittedDate&sortOrder=descending"

curl -sL "https://export.arxiv.org/api/query?search_query=abs:prompt+AND+abs:optimization+AND+abs:evolutionary&start=0&max_results=10&sortBy=relevance&sortOrder=descending"

# Combine category with keyword — every term must be explicitly scoped
curl -sL "https://export.arxiv.org/api/query?search_query=cat:cs.CL+AND+all:prompt+AND+all:optimization&start=0&max_results=10&sortBy=submittedDate&sortOrder=descending"

# Fetch a specific paper (old-style: hep-th/9905111, new-style: 2310.03714)
curl -sL "https://export.arxiv.org/api/query?id_list=2310.03714"

# Batch multiple IDs in one request (saves rate limit budget)
curl -sL "https://export.arxiv.org/api/query?id_list=2005.11401,2002.08909,2310.11511"

# AND, OR, ANDNOT operators
curl -sL "https://export.arxiv.org/api/query?search_query=all:DSPy+AND+all:prompt+AND+all:optimization&start=0&max_results=10"

# Page through results (start=0, start=10, start=20, ...)
curl -sL "https://export.arxiv.org/api/query?search_query=all:multi-agent+AND+all:LLM&start=0&max_results=10"
sleep 3
curl -sL "https://export.arxiv.org/api/query?search_query=all:multi-agent+AND+all:LLM&start=10&max_results=10"

# Encode a complex query
python3 -c "import urllib.parse; print(urllib.parse.quote_plus('retrieval augmented generation (RAG)'))"
# Output: retrieval+augmented+generation+%28RAG%29

curl -sL "https://export.arxiv.org/api/query?search_query=all:YOUR+QUERY&max_results=10" | \
  python3 -c "
import sys, xml.etree.ElementTree as ET

ns = {'atom': 'http://www.w3.org/2005/Atom', 'opensearch': 'http://a9.com/-/spec/opensearch/1.1/', 'arxiv': 'http://arxiv.org/schemas/atom'}

def get_text(el, tag, default=''):
    node = el.find(tag, ns)
    return node.text.strip().replace('\n', ' ') if node is not None and node.text else default

try:
    tree = ET.parse(sys.stdin.buffer)
except ET.ParseError:
    print('ERROR: Could not parse response. Check curl output manually.')
    print('Try: curl -sL \"https://export.arxiv.org/api/query?search_query=all:test&max_results=1\"')
    sys.exit(1)

root = tree.getroot()

total = root.find('opensearch:totalResults', ns)
if total is not None:
    print(f'Total results: {total.text}')
    if total.text == '0':
        print('NO RESULTS FOUND. Try broader keywords or different categories.')
        sys.exit(0)
print()

for entry in root.findall('atom:entry', ns):
    title = get_text(entry, 'atom:title', 'Untitled')
    raw_id = get_text(entry, 'atom:id')
    arxiv_id = raw_id.split('/abs/')[-1] if '/abs/' in raw_id else raw_id
    url = f'https://arxiv.org/abs/{arxiv_id}'
    published = get_text(entry, 'atom:published')[:10]
    updated = get_text(entry, 'atom:updated')[:10]
    full_summary = get_text(entry, 'atom:summary')
    summary = full_summary[:300] + ('...' if len(full_summary) > 300 else '')
    authors = ', '.join(get_text(a, 'atom:name', 'Unknown') for a in entry.findall('atom:author', ns))
    cats = ', '.join(c.get('term', '') for c in entry.findall('atom:category', ns))
    primary = entry.find('arxiv:primary_category', ns)
    primary_cat = primary.get('term') if primary is not None else 'unknown'
    comment_text = get_text(entry, 'arxiv:comment')
    print(f'## {title}')
    print(f'- **arXiv ID**: {arxiv_id}')
    print(f'- **URL**: {url}')
    print(f'- **PDF**: https://arxiv.org/pdf/{arxiv_id}.pdf')
    print(f'- **Published**: {published} (updated: {updated})')
    print(f'- **Authors**: {authors}')
    print(f'- **Primary Category**: {primary_cat}')
    print(f'- **All Categories**: {cats}')
    if comment_text:
        print(f'- **Comment**: {comment_text}')
    print(f'- **Abstract**: {summary}')
    print()
"

curl -sL "https://export.arxiv.org/api/query?search_query=all:YOUR+QUERY&max_results=1" | \
  python3 -c "
import sys, xml.etree.ElementTree as ET
ns = {'opensearch': 'http://a9.com/-/spec/opensearch/1.1/'}
try:
    root = ET.parse(sys.stdin.buffer).getroot()
    total = root.find('opensearch:totalResults', ns)
    print(f'Total results: {total.text}' if total is not None else 'Could not parse results')
except ET.ParseError:
    print('ERROR: Could not parse response.')
"

## Research Brief: [Topic]

**Date**: YYYY-MM-DD
**Queries**: [exact queries you ran]
**Categories**: [arXiv categories searched]
**Total results**: [number from opensearch:totalResults]

### Executive Summary
- Key finding 1 [Source: arXiv:XXXX.XXXXX]
- Key finding 2 [Source: arXiv:XXXX.XXXXX]

### Key Papers
1. **[Title]** (arXiv:XXXX.XXXXX, YYYY-MM-DD)
   - URL: https://arxiv.org/abs/XXXX.XXXXX
   - Authors: [author list]
   - Primary category: [cs.XX]
   - Venue: [from arxiv:comment, or "Preprint" if none]
   - Abstract: [brief summary]
   - Relevance: [why this paper matters for the research question]
   - Key contributions: [what it introduces or proves]

### Techniques & Methods
- [Technique 1]: [description, from which paper]
- [Technique 2]: [description, from which paper]

### Related Work
1. **[Title]** - [brief note on tangential relevance]

### Synthesis
- [How the papers relate to each other]
- [What the current state of the art is]
- [Open questions or gaps in the research]

### Recommendations
- [What to read first]
- [What to implement or try]

### Gaps
- [What you looked for but didn't find]
- [Queries that returned 0 results]