?j, UdZddlmZddlZddlZddlmZmZmZddlm Z m Z ddl m Z ddl Z dddd d d d d dZded<hdZddZddZddZddZddZy)uMPertamina POS Excel/CSV parser — reads .xlsx or .csv export into row dicts.) annotationsN)datedatetimetime)DecimalInvalidOperation)AnyRON90CN48RON92CN51CN53RON98RON95) PERTALITE BIO_SOLARBIOSOLARPERTAMAXDEXLITEPERTADEXzPERTAMAX TURBOzPERTAMAX GREENzdict[str, str] PRODUK_MAP>JamProdukTanggal No dispenserVolume (Liter)Penjualan (rupiah)c|j}d|vr|dfS|jdd}|dj}|djjdj}||fS)zPSplit "PULAU 1 - A2 MIX" -> ("PULAU 1", "A2"). Strips " MIX" suffix from nozzle.z - Nrz MIX)stripsplit removesuffix) no_dispenserrawpartsislandnozzles c|jj}tj|}|!|j|jk7rt d|d|dy)z_Check raw produk string matches expected produk kode. Raises ValueError with 'mismatch' if not.zproduk mismatch: file berisi 'z!' tapi produk yang dipilih kode ''T)r upperrget ValueError) produk_raw produk_kodekeymappeds r(validate_produk_matchr4)sl     " " $C ^^C F ~;+<+<+>>,ZL9..9]! =   r*cNdjd|DjS)zMStrip dots, dashes, spaces for loose comparison. '31.17201.01' -> '311720101'c3BK|]}|js|ywN)isalnum.0cs r( z%_normalize_spbu_no..7s/a199;1as)joinr-)ss r(_normalize_spbu_nor@5s 77/a/ / 5 5 77r*c Ltjtj|dd}|j}|j d}t |d}| td|Dcgc]}|t|jnd!c}ttz }|r&tddjt|d:fd g}d }t} d} |D]Etd Drd;fd } d<fd } | d} t| t r| j#}nt| t"r| }nb| d}t|t$r|}nst|trb |jj'd}t%t)|d t)|dt+|dkDrt)|dnd }n t/t| dxsd}t/t| dxsd}t| dxsdj}| j3|j5t| dxsdj}t7|\}}| d}|r| |} |d kxs|d k}|r|dz }|j9id|d|d| dd| dd| d d!|d"| d#d$|d%|d&|d'|d(| d)d*| d+d,| d-d.| d/d0| d1d2| d3||d4H|s td5t+| dkDr'td6djt| d7|| d8|d d9<|Scc}w#tt,f$rYwxYw#t0$rYwxYw)=aParse Pertamina .xlsx bytes -> list of row dicts with keys matching pos_transaksi_pertamina fields. Validation applied per-row: - Skip rows with volume = 0 (counted in skipped_invalid) - Skip rows with nilai = 0 but volume > 0, or nilai > 0 but volume = 0 (counted in skipped_invalid) Validation applied file-wide (raises ValueError): - All rows must have the same produk_raw (no mixed products) - Returns no_spbu_from_file so caller can validate against SPBU nomor_pertamina T) read_only data_only) values_onlyNzFile Excel kosongr6Kolom tidak ditemukan: , c&j|Sr8indexnameheaderss r(col_idxz#parse_xlsx_to_rows..col_idxS}}T""r*rc3$K|]}|du ywr8)r;vs r(r=z%parse_xlsx_to_rows..\s*'QqDy'sc>|}|tkr|SdSr8)len)rKidxrMraw_rows r(r.zparse_xlsx_to_rows..get_s&$-C#&W#573< ?4 ?r*c|vrj|nd}|dks|tk\ry|}|t|jSdS)Nr)rIrSstrr )rKrTrQrLrUs r(get_optz#parse_xlsx_to_rows..get_optcsP)-'--%bCQw#W- A%&]3q6<<> < sortedall isinstancerrrr!rrS IndexErrorrraddr-r)append) file_byteswbws rows_iter header_rowhmissingresultsr}produk_raw_setr~r.rY tanggal_valr^jam_valr_r%rirjr0r#rxryspbu_no is_suspiciousrMrLrUs @@@r(parse_xlsx_to_rowsr:s1    : 6$RV WB B  .Ii&J,--@JK 1s1v||~B6 KGW-G2499VG_3M2NOPP#%'GO"uN$( *'* *  @ =)n k8 ,!&&(G  T *!G e* gt $C  %  --c23uQx=#eAh-#e*WX.U1X^_`  S%5!6!=#>?FC$8 9 @SABEX,"-335 :++-.3~.4"5;;= !0!> J)$ (0 ' ! 1uz  q O w 3   +   +  GFO     -  L  *  f  U  WZ0  WW%  W_5  ',/ 75>! "  +# $%$'  s^ WXX >Q||d?| dd@<| S#t$r|jd}YwxYwcc}wcc}w#t*$rY6wxYw)EaParse Pertamina POS .csv bytes -> same row dict format as parse_xlsx_to_rows. Expects same columns as the xlsx export (semicolon or comma separated): Tanggal, Jam, No dispenser, Produk, Volume (Liter), Penjualan (rupiah) Optional: No spbu, Code_mor, Province, City, No nozzle, Operator, No HP, Delivery Type, Plat Nomor, NIK, Instansi Tanggal: dd/mm/yyyy or yyyy-mm-dd (auto-detected) Jam: HH:MM or HH:MM:SS z utf-8-sigzlatin-1zFile CSV kosongr;,) delimiterr[z,File CSV harus memiliki minimal 1 baris datarErFc&j|Sr8rHrJs r(rMz"parse_csv_to_rows..col_idxrNr*c2|vrj|SdS)NrWrHrJs r(opt_idxz"parse_csv_to_rows..opt_idxs&*gow}}T"=2=r*cf|}|t|kr||jnd}|r|SdS)Nr6rSr )rowrKrTrQrMs r(get_valz"parse_csv_to_rows..get_vals5dm #c#hCHNN Bq4r*cn|}|dks|t|k\ry||j}|r|SdS)Nrr)rrKrTrQrs r(rYz"parse_csv_to_rows..get_opts=dm 7cSXo HNN q4r*c|j}dD](} tj||jcSy#t$rY7wxYw)N)z%d/%m/%Yz%Y-%m-%dz%d-%m-%Yz%d/%m/%y)r rstrptimerr/)r?fmts r( parse_tanggalz(parse_csv_to_rows..parse_tanggalsR GGICC ((C05577D   s#? A  A c|j}|jd} tt|dt|dt |dkDrt|dSdS#t t f$rYywxYw)NrZrrr[)r r!rrrSr/r)r?r%s r( parse_jamz$parse_csv_to_rows..parse_jamsq GGI  E!H s58}s5zTU~c%(m] ][\] ]J'  s>A("A((A:9A:Nr)startc3>K|]}|j ywr8)r r:s r(r=z$parse_csv_to_rows..s*c1779}csrrrr\.rrr6rr]r^r_r`rarbrcrdrerfrgrhr#r0rirjrkrlrmrnrorprqrrrsrtrurvrwz:Tidak ada data valid dalam file CSV (semua baris dilewati)rzr{r|rr)rz list[str]rKrXrr)r?rXrz date | None)r?rXrz time | None)decodeUnicodeDecodeErrorr splitlinesr/countcsvreaderrStringIOlistrSlowerrrr>r enumeraterreplacerrrr-r)r)$rr$linesseprrowsr headers_lowerrrrYrrrr}rr~ir tanggal_strr^jam_strr_vol_strnil_strrirjr0r#rxryrrrMrLrs$ @@@r(parse_csv_to_rowsrs+ , IIK " " $E *++q$as(;;#C ZZ CIIK0C @F   %'GO"uN$(DHA..3 *c* * c9-   , ? #u%   ;  s$45<EEc3OGs$89@SII#sSGW%FG$Ec8,299; :++-.^4:AAC !0!> J#y) (0 ' ! 1uz  q O w 3  Z0  Z0  GC(     k2  L  *  f  U  WS*5  WS'*  WS/:  '#|4 73&! " Z0# $%$'  Q/| UVV >QrslS" ))-  N   8 @FVr*