Government open data search

Total datasets: 1 load time 0.06 min

Citywide Payroll Data (Fiscal Year) Data is collected because of public interest in ho... Office of Payroll Administration (OPA) 2024-02-01T15:27:14.000Z Search

{"serviceMillis":83,"searchMillis":[45,13]}

agency_start_date	fiscal_year	leave_status_as_of_june_30	base_salary	pay_basis	title_description	work_location_borough	regular_gross_paid	ot_hours	total_ot_paid	agency_name	payroll_number	regular_hours	total_other_pay
1992-08-24T00:00:00.000	2023	CEASED	110754.00	per Annum	SUPERVISING RACKETS INVESTIGATOR START >4-24-08 NO ABC	QUEENS	0.00	0.00	0.00	DISTRICT ATTORNEY QNS COUNTY	904	0.00	14156.63
2023-05-15T00:00:00.000	2023	ACTIVE	66136.00	per Annum	SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC	QUEENS	6341.80	0.00	0.00	DISTRICT ATTORNEY QNS COUNTY	904	200.00	0.00
2023-04-10T00:00:00.000	2023	CEASED	66136.00	per Annum	SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC	QUEENS	6436.81	0.00	0.00	DISTRICT ATTORNEY QNS COUNTY	904	203.00	0.00
2023-04-24T00:00:00.000	2023	ACTIVE	56000.00	per Annum	RACKETS INVESTIGATOR - START >4-24-08 NO ABC	QUEENS	8591.80	6.00	241.37	DISTRICT ATTORNEY QNS COUNTY	904	320.00	0.00
2023-05-01T00:00:00.000	2023	ACTIVE	66136.00	per Annum	SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC	QUEENS	8878.52	0.00	0.00	DISTRICT ATTORNEY QNS COUNTY	904	280.00	17.00
2023-04-24T00:00:00.000	2023	CEASED	66136.00	per Annum	SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC	QUEENS	9076.57	4.00	190.04	DISTRICT ATTORNEY QNS COUNTY	904	286.25	0.00
2013-06-03T00:00:00.000	2023	CEASED	75386.00	per Annum	SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC	QUEENS	9541.91	0.00	0.00	DISTRICT ATTORNEY QNS COUNTY	904	264.00	1413.16
2021-01-29T00:00:00.000	2023	CEASED	57076.00	per Annum	RACKETS INVESTIGATOR - START >4-24-08 NO ABC	QUEENS	11397.58	23.50	963.55	DISTRICT ATTORNEY QNS COUNTY	904	416.50	5000.00
2023-04-10T00:00:00.000	2023	ACTIVE	66136.00	per Annum	SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC	QUEENS	12683.60	0.00	0.00	DISTRICT ATTORNEY QNS COUNTY	904	400.00	0.00
2023-04-10T00:00:00.000	2023	ACTIVE	66136.00	per Annum	SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC	QUEENS	12683.60	0.00	0.00	DISTRICT ATTORNEY QNS COUNTY	904	400.00	0.00


  data:
    [
   {
      "agency_start_date": "1992-08-24T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "CEASED",
      "base_salary": "110754.00",
      "pay_basis": "per Annum",
      "title_description": "SUPERVISING RACKETS INVESTIGATOR START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "0.00",
      "ot_hours": "0.00",
      "total_ot_paid": "0.00",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "0.00",
      "total_other_pay": "14156.63"
   },
   {
      "agency_start_date": "2023-05-15T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "ACTIVE",
      "base_salary": "66136.00",
      "pay_basis": "per Annum",
      "title_description": "SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "6341.80",
      "ot_hours": "0.00",
      "total_ot_paid": "0.00",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "200.00",
      "total_other_pay": "0.00"
   },
   {
      "agency_start_date": "2023-04-10T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "CEASED",
      "base_salary": "66136.00",
      "pay_basis": "per Annum",
      "title_description": "SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "6436.81",
      "ot_hours": "0.00",
      "total_ot_paid": "0.00",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "203.00",
      "total_other_pay": "0.00"
   },
   {
      "agency_start_date": "2023-04-24T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "ACTIVE",
      "base_salary": "56000.00",
      "pay_basis": "per Annum",
      "title_description": "RACKETS INVESTIGATOR - START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "8591.80",
      "ot_hours": "6.00",
      "total_ot_paid": "241.37",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "320.00",
      "total_other_pay": "0.00"
   },
   {
      "agency_start_date": "2023-05-01T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "ACTIVE",
      "base_salary": "66136.00",
      "pay_basis": "per Annum",
      "title_description": "SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "8878.52",
      "ot_hours": "0.00",
      "total_ot_paid": "0.00",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "280.00",
      "total_other_pay": "17.00"
   },
   {
      "agency_start_date": "2023-04-24T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "CEASED",
      "base_salary": "66136.00",
      "pay_basis": "per Annum",
      "title_description": "SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "9076.57",
      "ot_hours": "4.00",
      "total_ot_paid": "190.04",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "286.25",
      "total_other_pay": "0.00"
   },
   {
      "agency_start_date": "2013-06-03T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "CEASED",
      "base_salary": "75386.00",
      "pay_basis": "per Annum",
      "title_description": "SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "9541.91",
      "ot_hours": "0.00",
      "total_ot_paid": "0.00",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "264.00",
      "total_other_pay": "1413.16"
   },
   {
      "agency_start_date": "2021-01-29T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "CEASED",
      "base_salary": "57076.00",
      "pay_basis": "per Annum",
      "title_description": "RACKETS INVESTIGATOR - START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "11397.58",
      "ot_hours": "23.50",
      "total_ot_paid": "963.55",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "416.50",
      "total_other_pay": "5000.00"
   },
   {
      "agency_start_date": "2023-04-10T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "ACTIVE",
      "base_salary": "66136.00",
      "pay_basis": "per Annum",
      "title_description": "SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "12683.60",
      "ot_hours": "0.00",
      "total_ot_paid": "0.00",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "400.00",
      "total_other_pay": "0.00"
   },
   {
      "agency_start_date": "2023-04-10T00:00:00.000",
      "fiscal_year": "2023",
      "leave_status_as_of_june_30": "ACTIVE",
      "base_salary": "66136.00",
      "pay_basis": "per Annum",
      "title_description": "SENIOR RACKETS INVESTIGATOR - START >4-24-08 NO ABC",
      "work_location_borough": "QUEENS",
      "regular_gross_paid": "12683.60",
      "ot_hours": "0.00",
      "total_ot_paid": "0.00",
      "agency_name": "DISTRICT ATTORNEY QNS COUNTY",
      "payroll_number": "904",
      "regular_hours": "400.00",
      "total_other_pay": "0.00"
   }
]

  keys:
    [
   "agency_start_date",
   "fiscal_year",
   "leave_status_as_of_june_30",
   "base_salary",
   "pay_basis",
   "title_description",
   "work_location_borough",
   "regular_gross_paid",
   "ot_hours",
   "total_ot_paid",
   "agency_name",
   "payroll_number",
   "regular_hours",
   "total_other_pay"
]

directoryQuery: https://api.us.socrata.com/api/catalog/v1?ids=k397-673e&limit=100

permalink: https://data.cityofnewyork.us/d/k397-673e

dataQuery: https://data.cityofnewyork.us/resource/k397-673e.json?$select=agency_start_date%2Cfiscal_year%2Cleave_status_as_of_june_30%2Cbase_salary%2Cpay_basis%2Ctitle_description%2Cwork_location_borough%2Cregular_gross_paid%2Cot_hours%2Ctotal_ot_paid%2Cmid_init%2Cfirst_name%2Clast_name%2Cagency_name%2Cpayroll_number%2Cregular_hours%2Ctotal_other_pay&$order=first_name%20desc&$limit=10&$offset=0&$q=

Sites such as socrata.com appear to be tools to bring transparency to our governments. But what do they actually do in practice. This site attempts to use socrata.com (and hopefully all other "open transparency sites") to understand what the state of affairs are at the moment.

A summary view of the catalog when you filter for the word salary shows the lack of standarization.

Employee Salaries This dataset provides base salary information abou... Ramona Benson, Department of Human Resources Search
Current Employee Names, Salaries, and Position Tit... This dataset is a listing of all active City of Ch... City of Chicago Search
Budget - Salaries Budgeted Salaries by Position null Search
State of Vermont Employee Salaries Salary information for State of Vermont active emp... Department of Human Resources Search
Title and Salary Listing The Title and Salary Listing is a compilation of j... New York State Department of Civil Service Search

The screenshot shows a sample of name and descriptions of government uploaded salary transparency information. First of all, the information appears to be not easy to find for the general public. And even if the general public finds it, it is hard to tell what government it applies to. For example, there are datasets that simply have the name "Employee Salaries" and some that have no attribution at all. The column names are a mix of whatever the hundreds of individuals decided to use. This makes organization difficult, but not impossible.

Let's organize the information and overcome the obstacles!

Socrata Meta Catalog API

The Socrata Meta Catalog API provides access to metadata about the datasets and tables available on the Socrata Open Data Portal.

Getting Started

Create a Socrata developer account at https://dev.socrata.com.
Get an API access token from the API Access Tokens page.
Send a GET request to the /catalog/v1 endpoint with the following parameters:

access_token: Your API access token.
domain: The domain of the Socrata Open Data Portal you want to access.

For example, the following request will return a list of all the datasets available on the City of Boston's Open Data Portal:


            GET https://data.boston.gov/catalog/v1?access_token=YOUR_ACCESS_TOKEN

The response will be a JSON object containing an array of dataset objects. Each dataset object will contain the following properties:

id: The unique identifier for the dataset.
name: The name of the dataset.
description: A description of the dataset.
attribution: The attribution for the dataset.
attribution_link: A link to the attribution for the dataset.
tags: An array of tags associated with the dataset.
views: The number of views the dataset has received.
downloads: The number of downloads the dataset has received.
source: The source of the dataset.
contact_email: The contact email for the dataset.
contact_name: The contact name for the dataset.
contact_phone: The contact phone number for the dataset.
contact_address: The contact address for the dataset.
metadata_created_at: The date and time the dataset was created.
metadata_updated_at: The date and time the dataset was last updated.
data_updated_at: The date and time the dataset data was last updated.
url: The URL of the dataset.
resource_count: The number of resources in the dataset.

Using the API

The Socrata Meta Catalog API can be used to perform a variety of tasks, such as:

Find datasets that match specific criteria.
Get detailed information about a specific dataset.
List the resources in a dataset.
Get detailed information about a specific resource.
Search for datasets and resources.

For more information on how to use the API, please refer to the Socrata Meta Catalog API documentation.

    debug: columns: name:
    [
   "Agency Name",
   "Agency Start Date",
   "Base Salary",
   "First Name",
   "Fiscal Year",
   "Last Name",
   "Leave Status as of June 30",
   "Mid Init",
   "OT Hours",
   "Pay Basis",
   "Payroll Number",
   "Regular Gross Paid",
   "Regular Hours",
   "Title Description",
   "Total OT Paid",
   "Total Other Pay",
   "Work Location Borough"
]

    debug: columns: type:
    [
   "Calendar date",
   "Number",
   "Number",
   "Number",
   "Number",
   "Number",
   "Number",
   "Number",
   "Number",
   "Text",
   "Text",
   "Text",
   "Text",
   "Text",
   "Text",
   "Text",
   "Text"
]

Open Government Transparency Search for * in us

Preview of information for * in us

Socrata Meta Catalog API

Getting Started

Using the API