I have a huge text file of entries, all of which have a timestamp. These entries are read and the timestamp on each entry is converted to a DateTime. The problem is that the timestamps are different if the DateTime objects are converted back, this is causing a problem with false duplicates and generally a… Read More C# : Converting a timestamp to a DateTime, then back to a timestamp gives different values

I recently updated Pandas to the latest version, 1.5.3. I was using a version pre 1.4 previously. With the newest update I am getting a bunch of depreciation notices on index.get_loc and I am to use index.get_indexer. I updated my code to get_indexer, but now I am receiving a bunch of errors. My code uses… Read More Pandas 1.5.3 Index.get_indexer not working like index.get_loc

Problem: I have a lot of datapoints that are too close to each other in terms of timestamps meaning that when I manipulate the data, I am oversampling. What I need: For each element in the dataframe, I need to drop all elements that are within a 5 second range from it. This means that… Read More Remove timestamps that are close to each other or within threshold in a dataframe

I’m trying to create a function, which returns a random TIMESTAMP between a range of timestamps. It doesn’t appear to be working ALL the time as sometimes I get a value back before the starting range and sometimes I get a value back after the ending range. Below is my test CASE and example of… Read More Random TIMESTAMP out of range

I have a dataframe df = pd.DataFrame([["A","11:40 AM"],["B","12:51 PM"],["C","6:33 PM"],["D","11:13 AM"],["E","7:13 PM"]],columns=["id","time"]) id time A 11:40 AM B 12:51 PM C 6:33 PM D 11:13 AM E 7:13 PM I want to select only those rows which are < 6:30 PM. Expected output: df = pd.DataFrame([["A","11:40 AM"],["B","12:51 PM"],["D","11:13 AM"]],columns=["id","time"]) id time A 11:40 AM B… Read More Select the dataframe based on the certain time value in pandas

I keep daily log files (like logfile-2022-01-01.log, logfile-2022-01-02.log, and so on). Every line on the files starts with a timestamp, e.g: [2022-05-01 10:00:34.550] …some strings…. –> this being YYYY-MM-DD HH:MM:SS.sss I need to filter all the lines between two timestamps, this could mean search in more than one file. For instance: logfile-2022-01-01.log [2022-01-01 00:00:25.550] here… Read More Unix get lines between timestamps on multiple files

I’m working with BigQuery and have a table that looks like: YEAR MONTH DAY timezone local time 2015 6 24 America/Los Angeles 1930 Where local time is given by hhmm. I’m wondering if I can format this information into a timestamp column in SQL that yields time in UTC. I know I can use `TO_TIMESTAMP`… Read More SQL – Creating UTC Timestamp from separate date/time/timezone information

I have a DF1 where each row represents an "event". Each event has the columns "user", and "time": DF1: "user","time" user1,2022-11-14 00:00:04 user2,2022-11-16 21:34:45 user1,2022-11-14 00:15:22 user3,2022-11-17 15:32:25 … The "time" value is any timestamp in one week: from 2022-11-14 and 2022-11-20. There are 10k different users, and 27M events. I have to divide the… Read More Pandas groupby user and count number of events between 2 timestamps

I am trying to insert some datetime values and I came up with a non sense data truncation problem, and I have no idea how to solve and what is causing it. Hope someone helps! I have the following table: CREATE TABLE tb_cliente ( id bigint unsigned NOT NULL AUTO_INCREMENT, st_servidor tinyint(1) NOT NULL, nm_nome… Read More How does this data truncation possible?

What I expect: SELECT to_char(current_timestamp AT TIME ZONE ‘UTC’, ‘YYYY-MM-DDTHH24-MI-SS’) to produce: 2022-11-11T11-29-51 But it produces: I’ve tried several options, but neither of them does the trick: Query for convenience: SELECT to_char(current_timestamp AT TIME ZONE ‘UTC’, ‘YYYY-MM-DDTHH24-MI-SS’) as plain, to_char(current_timestamp AT TIME ZONE ‘UTC’, E’YYYY-MM-DD\’T\’HH24-MI-SS’) as with_quotes, to_char(current_timestamp AT TIME ZONE ‘UTC’, ‘YYYY-MM-DD\THH24-MI-SS’) as with_backslash,… Read More PostgreSQL: format timestamp with T delimiter between time and date